2023-09-27 00:00:50,754 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-09-27 00:00:50,946 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f 2023-09-27 00:00:50,947 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-09-27 00:00:50,947 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-09-27 00:00:50,983 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-09-27 00:00:51,253 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-09-27 00:00:51,254 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/cluster_7e1535aa-dfbb-2328-367c-8d044f898abe, deleteOnExit=true 2023-09-27 00:00:51,254 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-09-27 00:00:51,255 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/test.cache.data in system properties and HBase conf 2023-09-27 00:00:51,256 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/hadoop.tmp.dir in system properties and HBase conf 2023-09-27 00:00:51,256 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/hadoop.log.dir in system properties and HBase conf 2023-09-27 00:00:51,257 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-27 00:00:51,257 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-27 00:00:51,257 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-27 00:00:51,580 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-09-27 00:00:51,584 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-27 00:00:51,585 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-27 00:00:51,585 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-27 00:00:51,585 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-27 00:00:51,585 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-27 00:00:51,586 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-27 00:00:51,586 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-27 00:00:51,586 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-27 00:00:51,586 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-27 00:00:51,587 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/nfs.dump.dir in system properties and HBase conf 2023-09-27 00:00:51,587 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/java.io.tmpdir in system properties and HBase conf 2023-09-27 00:00:51,587 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-27 00:00:51,587 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-27 00:00:51,588 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-09-27 00:00:52,110 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-27 00:00:52,115 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-27 00:00:52,418 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-09-27 00:00:52,605 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-09-27 00:00:52,621 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-27 00:00:52,659 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-09-27 00:00:52,692 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/java.io.tmpdir/Jetty_localhost_36975_hdfs____.mayi82/webapp 2023-09-27 00:00:52,837 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36975 2023-09-27 00:00:52,848 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-27 00:00:52,849 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-27 00:00:53,335 WARN [Listener at localhost/40313] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-27 00:00:53,412 WARN [Listener at localhost/40313] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-27 00:00:53,432 WARN [Listener at localhost/40313] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-27 00:00:53,485 INFO [Listener at localhost/40313] log.Slf4jLog(67): jetty-6.1.26 2023-09-27 00:00:53,491 INFO [Listener at localhost/40313] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/java.io.tmpdir/Jetty_localhost_32921_datanode____ymhw4g/webapp 2023-09-27 00:00:53,590 INFO [Listener at localhost/40313] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:32921 2023-09-27 00:00:53,995 WARN [Listener at localhost/42257] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-27 00:00:54,010 WARN [Listener at localhost/42257] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-27 00:00:54,014 WARN [Listener at localhost/42257] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-27 00:00:54,016 INFO [Listener at localhost/42257] log.Slf4jLog(67): jetty-6.1.26 2023-09-27 00:00:54,023 INFO [Listener at localhost/42257] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/java.io.tmpdir/Jetty_localhost_38389_datanode____tie6hi/webapp 2023-09-27 00:00:54,118 INFO [Listener at localhost/42257] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38389 2023-09-27 00:00:54,135 WARN [Listener at localhost/38127] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-27 00:00:54,161 WARN [Listener at localhost/38127] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-27 00:00:54,165 WARN [Listener at localhost/38127] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-27 00:00:54,167 INFO [Listener at localhost/38127] log.Slf4jLog(67): jetty-6.1.26 2023-09-27 00:00:54,176 INFO [Listener at localhost/38127] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/java.io.tmpdir/Jetty_localhost_34683_datanode____p4s7tj/webapp 2023-09-27 00:00:54,312 INFO [Listener at localhost/38127] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34683 2023-09-27 00:00:54,323 WARN [Listener at localhost/37551] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-27 00:00:54,577 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x63dcecee9335a2b0: Processing first storage report for DS-98c4e38d-cad1-4038-845f-b4f7d1c16be1 from datanode 34b95faf-6ce0-4f68-8f0a-b4cd76bb2759 2023-09-27 00:00:54,579 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x63dcecee9335a2b0: from storage DS-98c4e38d-cad1-4038-845f-b4f7d1c16be1 node DatanodeRegistration(127.0.0.1:40009, datanodeUuid=34b95faf-6ce0-4f68-8f0a-b4cd76bb2759, infoPort=36699, infoSecurePort=0, ipcPort=37551, storageInfo=lv=-57;cid=testClusterID;nsid=1492997546;c=1695772852197), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-09-27 00:00:54,579 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe3cae0449a12bc28: Processing first storage report for DS-57fb5dbe-d6d3-4d17-9108-e0bf8b6598ae from datanode ba0db50a-8e06-4adc-bec3-f536863efcfa 2023-09-27 00:00:54,579 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe3cae0449a12bc28: from storage DS-57fb5dbe-d6d3-4d17-9108-e0bf8b6598ae node DatanodeRegistration(127.0.0.1:41377, datanodeUuid=ba0db50a-8e06-4adc-bec3-f536863efcfa, infoPort=44261, infoSecurePort=0, ipcPort=38127, storageInfo=lv=-57;cid=testClusterID;nsid=1492997546;c=1695772852197), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-09-27 00:00:54,580 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xeae2552b071ecae2: Processing first storage report for DS-d2e51846-6c95-4dbe-8e75-3c098e734cf6 from datanode a3301cf4-5fd9-4839-baf3-4ef9d2693182 2023-09-27 00:00:54,580 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xeae2552b071ecae2: from storage DS-d2e51846-6c95-4dbe-8e75-3c098e734cf6 node DatanodeRegistration(127.0.0.1:35499, datanodeUuid=a3301cf4-5fd9-4839-baf3-4ef9d2693182, infoPort=37109, infoSecurePort=0, ipcPort=42257, storageInfo=lv=-57;cid=testClusterID;nsid=1492997546;c=1695772852197), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-27 00:00:54,580 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x63dcecee9335a2b0: Processing first storage report for DS-51a5df65-66a3-417d-aaf6-ea9bad9f6299 from datanode 34b95faf-6ce0-4f68-8f0a-b4cd76bb2759 2023-09-27 00:00:54,580 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x63dcecee9335a2b0: from storage DS-51a5df65-66a3-417d-aaf6-ea9bad9f6299 node DatanodeRegistration(127.0.0.1:40009, datanodeUuid=34b95faf-6ce0-4f68-8f0a-b4cd76bb2759, infoPort=36699, infoSecurePort=0, ipcPort=37551, storageInfo=lv=-57;cid=testClusterID;nsid=1492997546;c=1695772852197), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-27 00:00:54,580 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe3cae0449a12bc28: Processing first storage report for DS-3d1ef976-2cb6-4cdb-8462-c591ea1751f7 from datanode ba0db50a-8e06-4adc-bec3-f536863efcfa 2023-09-27 00:00:54,581 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe3cae0449a12bc28: from storage DS-3d1ef976-2cb6-4cdb-8462-c591ea1751f7 node DatanodeRegistration(127.0.0.1:41377, datanodeUuid=ba0db50a-8e06-4adc-bec3-f536863efcfa, infoPort=44261, infoSecurePort=0, ipcPort=38127, storageInfo=lv=-57;cid=testClusterID;nsid=1492997546;c=1695772852197), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-27 00:00:54,581 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xeae2552b071ecae2: Processing first storage report for DS-c2fdb280-d338-4a45-8e43-0fb3d723b9f0 from datanode a3301cf4-5fd9-4839-baf3-4ef9d2693182 2023-09-27 00:00:54,581 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xeae2552b071ecae2: from storage DS-c2fdb280-d338-4a45-8e43-0fb3d723b9f0 node DatanodeRegistration(127.0.0.1:35499, datanodeUuid=a3301cf4-5fd9-4839-baf3-4ef9d2693182, infoPort=37109, infoSecurePort=0, ipcPort=42257, storageInfo=lv=-57;cid=testClusterID;nsid=1492997546;c=1695772852197), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-27 00:00:54,772 DEBUG [Listener at localhost/37551] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f 2023-09-27 00:00:54,859 INFO [Listener at localhost/37551] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/cluster_7e1535aa-dfbb-2328-367c-8d044f898abe/zookeeper_0, clientPort=57983, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/cluster_7e1535aa-dfbb-2328-367c-8d044f898abe/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/cluster_7e1535aa-dfbb-2328-367c-8d044f898abe/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-09-27 00:00:54,877 INFO [Listener at localhost/37551] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=57983 2023-09-27 00:00:54,888 INFO [Listener at localhost/37551] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 00:00:54,891 INFO [Listener at localhost/37551] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 00:00:55,577 INFO [Listener at localhost/37551] util.FSUtils(471): Created version file at hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8 with version=8 2023-09-27 00:00:55,577 INFO [Listener at localhost/37551] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/hbase-staging 2023-09-27 00:00:55,988 INFO [Listener at localhost/37551] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-09-27 00:00:56,471 INFO [Listener at localhost/37551] client.ConnectionUtils(127): master/jenkins-hbase9:0 server-side Connection retries=45 2023-09-27 00:00:56,503 INFO [Listener at localhost/37551] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-27 00:00:56,503 INFO [Listener at localhost/37551] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-27 00:00:56,503 INFO [Listener at localhost/37551] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-27 00:00:56,504 INFO [Listener at localhost/37551] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-27 00:00:56,504 INFO [Listener at localhost/37551] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-27 00:00:56,654 INFO [Listener at localhost/37551] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-09-27 00:00:56,726 DEBUG [Listener at localhost/37551] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-09-27 00:00:56,815 INFO [Listener at localhost/37551] ipc.NettyRpcServer(120): Bind to /172.31.2.10:33541 2023-09-27 00:00:56,828 INFO [Listener at localhost/37551] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 00:00:56,830 INFO [Listener at localhost/37551] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 00:00:56,853 INFO [Listener at localhost/37551] zookeeper.RecoverableZooKeeper(93): Process identifier=master:33541 connecting to ZooKeeper ensemble=127.0.0.1:57983 2023-09-27 00:00:56,911 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:335410x0, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-27 00:00:56,914 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:33541-0x100eaa1be8f0000 connected 2023-09-27 00:00:56,946 DEBUG [Listener at localhost/37551] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-27 00:00:56,947 DEBUG [Listener at localhost/37551] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-27 00:00:56,965 DEBUG [Listener at localhost/37551] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-27 00:00:56,976 DEBUG [Listener at localhost/37551] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33541 2023-09-27 00:00:56,977 DEBUG [Listener at localhost/37551] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33541 2023-09-27 00:00:56,978 DEBUG [Listener at localhost/37551] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33541 2023-09-27 00:00:56,979 DEBUG [Listener at localhost/37551] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33541 2023-09-27 00:00:56,979 DEBUG [Listener at localhost/37551] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33541 2023-09-27 00:00:56,985 INFO [Listener at localhost/37551] master.HMaster(444): hbase.rootdir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8, hbase.cluster.distributed=false 2023-09-27 00:00:57,056 INFO [Listener at localhost/37551] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-09-27 00:00:57,057 INFO [Listener at localhost/37551] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-27 00:00:57,057 INFO [Listener at localhost/37551] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-27 00:00:57,057 INFO [Listener at localhost/37551] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-27 00:00:57,057 INFO [Listener at localhost/37551] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-27 00:00:57,057 INFO [Listener at localhost/37551] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-27 00:00:57,062 INFO [Listener at localhost/37551] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-27 00:00:57,065 INFO [Listener at localhost/37551] ipc.NettyRpcServer(120): Bind to /172.31.2.10:41869 2023-09-27 00:00:57,067 INFO [Listener at localhost/37551] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-27 00:00:57,073 INFO [Listener at localhost/37551] mob.MobFileCache(124): MobFileCache disabled 2023-09-27 00:00:57,074 INFO [Listener at localhost/37551] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 00:00:57,076 INFO [Listener at localhost/37551] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 00:00:57,078 INFO [Listener at localhost/37551] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41869 connecting to ZooKeeper ensemble=127.0.0.1:57983 2023-09-27 00:00:57,085 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:418690x0, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-27 00:00:57,086 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:41869-0x100eaa1be8f0001 connected 2023-09-27 00:00:57,086 DEBUG [Listener at localhost/37551] zookeeper.ZKUtil(164): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-27 00:00:57,087 DEBUG [Listener at localhost/37551] zookeeper.ZKUtil(164): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-27 00:00:57,088 DEBUG [Listener at localhost/37551] zookeeper.ZKUtil(164): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-27 00:00:57,089 DEBUG [Listener at localhost/37551] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41869 2023-09-27 00:00:57,090 DEBUG [Listener at localhost/37551] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41869 2023-09-27 00:00:57,091 DEBUG [Listener at localhost/37551] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41869 2023-09-27 00:00:57,091 DEBUG [Listener at localhost/37551] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41869 2023-09-27 00:00:57,091 DEBUG [Listener at localhost/37551] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41869 2023-09-27 00:00:57,104 INFO [Listener at localhost/37551] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-09-27 00:00:57,104 INFO [Listener at localhost/37551] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-27 00:00:57,104 INFO [Listener at localhost/37551] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-27 00:00:57,105 INFO [Listener at localhost/37551] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-27 00:00:57,105 INFO [Listener at localhost/37551] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-27 00:00:57,105 INFO [Listener at localhost/37551] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-27 00:00:57,105 INFO [Listener at localhost/37551] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-27 00:00:57,107 INFO [Listener at localhost/37551] ipc.NettyRpcServer(120): Bind to /172.31.2.10:41703 2023-09-27 00:00:57,107 INFO [Listener at localhost/37551] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-27 00:00:57,108 INFO [Listener at localhost/37551] mob.MobFileCache(124): MobFileCache disabled 2023-09-27 00:00:57,109 INFO [Listener at localhost/37551] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 00:00:57,112 INFO [Listener at localhost/37551] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 00:00:57,115 INFO [Listener at localhost/37551] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41703 connecting to ZooKeeper ensemble=127.0.0.1:57983 2023-09-27 00:00:57,118 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:417030x0, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-27 00:00:57,119 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:41703-0x100eaa1be8f0002 connected 2023-09-27 00:00:57,119 DEBUG [Listener at localhost/37551] zookeeper.ZKUtil(164): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-27 00:00:57,120 DEBUG [Listener at localhost/37551] zookeeper.ZKUtil(164): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-27 00:00:57,121 DEBUG [Listener at localhost/37551] zookeeper.ZKUtil(164): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-27 00:00:57,122 DEBUG [Listener at localhost/37551] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41703 2023-09-27 00:00:57,124 DEBUG [Listener at localhost/37551] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41703 2023-09-27 00:00:57,128 DEBUG [Listener at localhost/37551] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41703 2023-09-27 00:00:57,129 DEBUG [Listener at localhost/37551] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41703 2023-09-27 00:00:57,129 DEBUG [Listener at localhost/37551] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41703 2023-09-27 00:00:57,140 INFO [Listener at localhost/37551] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-09-27 00:00:57,140 INFO [Listener at localhost/37551] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-27 00:00:57,141 INFO [Listener at localhost/37551] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-27 00:00:57,141 INFO [Listener at localhost/37551] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-27 00:00:57,141 INFO [Listener at localhost/37551] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-27 00:00:57,141 INFO [Listener at localhost/37551] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-27 00:00:57,141 INFO [Listener at localhost/37551] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-27 00:00:57,142 INFO [Listener at localhost/37551] ipc.NettyRpcServer(120): Bind to /172.31.2.10:36739 2023-09-27 00:00:57,143 INFO [Listener at localhost/37551] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-27 00:00:57,143 INFO [Listener at localhost/37551] mob.MobFileCache(124): MobFileCache disabled 2023-09-27 00:00:57,144 INFO [Listener at localhost/37551] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 00:00:57,146 INFO [Listener at localhost/37551] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 00:00:57,147 INFO [Listener at localhost/37551] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36739 connecting to ZooKeeper ensemble=127.0.0.1:57983 2023-09-27 00:00:57,150 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:367390x0, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-27 00:00:57,151 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:36739-0x100eaa1be8f0003 connected 2023-09-27 00:00:57,151 DEBUG [Listener at localhost/37551] zookeeper.ZKUtil(164): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-27 00:00:57,152 DEBUG [Listener at localhost/37551] zookeeper.ZKUtil(164): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-27 00:00:57,153 DEBUG [Listener at localhost/37551] zookeeper.ZKUtil(164): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-27 00:00:57,154 DEBUG [Listener at localhost/37551] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36739 2023-09-27 00:00:57,154 DEBUG [Listener at localhost/37551] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36739 2023-09-27 00:00:57,155 DEBUG [Listener at localhost/37551] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36739 2023-09-27 00:00:57,155 DEBUG [Listener at localhost/37551] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36739 2023-09-27 00:00:57,156 DEBUG [Listener at localhost/37551] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36739 2023-09-27 00:00:57,160 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase9.apache.org,33541,1695772855814 2023-09-27 00:00:57,170 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-27 00:00:57,172 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase9.apache.org,33541,1695772855814 2023-09-27 00:00:57,191 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-27 00:00:57,191 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-27 00:00:57,191 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-27 00:00:57,191 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-27 00:00:57,192 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 00:00:57,192 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-27 00:00:57,194 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase9.apache.org,33541,1695772855814 from backup master directory 2023-09-27 00:00:57,194 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-27 00:00:57,198 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase9.apache.org,33541,1695772855814 2023-09-27 00:00:57,198 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-27 00:00:57,199 WARN [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-27 00:00:57,199 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase9.apache.org,33541,1695772855814 2023-09-27 00:00:57,202 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-09-27 00:00:57,204 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-09-27 00:00:57,294 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/hbase.id with ID: a177636e-dc85-4587-a5f4-fa8e64a1c0ca 2023-09-27 00:00:57,333 INFO [master/jenkins-hbase9:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 00:00:57,348 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 00:00:57,399 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x2cf31254 to 127.0.0.1:57983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 00:00:57,433 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3804ec58, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 00:00:57,457 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-27 00:00:57,458 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-09-27 00:00:57,475 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-09-27 00:00:57,475 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-09-27 00:00:57,477 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-27 00:00:57,481 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-27 00:00:57,483 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-27 00:00:57,517 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/MasterData/data/master/store-tmp 2023-09-27 00:00:57,557 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 00:00:57,557 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-27 00:00:57,557 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-27 00:00:57,557 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-27 00:00:57,557 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-27 00:00:57,557 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-27 00:00:57,557 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-27 00:00:57,557 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-27 00:00:57,559 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/MasterData/WALs/jenkins-hbase9.apache.org,33541,1695772855814 2023-09-27 00:00:57,581 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C33541%2C1695772855814, suffix=, logDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/MasterData/WALs/jenkins-hbase9.apache.org,33541,1695772855814, archiveDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/MasterData/oldWALs, maxLogs=10 2023-09-27 00:00:57,636 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41377,DS-57fb5dbe-d6d3-4d17-9108-e0bf8b6598ae,DISK] 2023-09-27 00:00:57,636 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40009,DS-98c4e38d-cad1-4038-845f-b4f7d1c16be1,DISK] 2023-09-27 00:00:57,636 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35499,DS-d2e51846-6c95-4dbe-8e75-3c098e734cf6,DISK] 2023-09-27 00:00:57,644 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-09-27 00:00:57,717 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/MasterData/WALs/jenkins-hbase9.apache.org,33541,1695772855814/jenkins-hbase9.apache.org%2C33541%2C1695772855814.1695772857592 2023-09-27 00:00:57,718 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40009,DS-98c4e38d-cad1-4038-845f-b4f7d1c16be1,DISK], DatanodeInfoWithStorage[127.0.0.1:41377,DS-57fb5dbe-d6d3-4d17-9108-e0bf8b6598ae,DISK], DatanodeInfoWithStorage[127.0.0.1:35499,DS-d2e51846-6c95-4dbe-8e75-3c098e734cf6,DISK]] 2023-09-27 00:00:57,718 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-09-27 00:00:57,719 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 00:00:57,722 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-09-27 00:00:57,723 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-09-27 00:00:57,787 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-09-27 00:00:57,795 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-09-27 00:00:57,823 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-09-27 00:00:57,835 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 00:00:57,841 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-27 00:00:57,843 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-27 00:00:57,862 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-09-27 00:00:57,866 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 00:00:57,867 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60911691, jitterRate=-0.09234507381916046}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 00:00:57,867 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-27 00:00:57,868 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-09-27 00:00:57,890 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-09-27 00:00:57,890 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-09-27 00:00:57,893 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-09-27 00:00:57,894 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 0 msec 2023-09-27 00:00:57,929 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 34 msec 2023-09-27 00:00:57,929 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-09-27 00:00:57,957 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-09-27 00:00:57,962 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-09-27 00:00:57,986 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-09-27 00:00:57,991 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-09-27 00:00:57,992 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-09-27 00:00:57,995 INFO [master/jenkins-hbase9:0:becomeActiveMaster] normalizer.SimpleRegionNormalizer(156): Updated configuration for key 'hbase.normalizer.merge.merge_request_max_number_of_regions' from 100 to 50 2023-09-27 00:00:57,998 INFO [master/jenkins-hbase9:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-09-27 00:00:58,002 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-09-27 00:00:58,005 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 00:00:58,006 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-09-27 00:00:58,007 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-09-27 00:00:58,023 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-09-27 00:00:58,028 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-27 00:00:58,028 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-27 00:00:58,028 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-27 00:00:58,028 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 00:00:58,028 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-27 00:00:58,030 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase9.apache.org,33541,1695772855814, sessionid=0x100eaa1be8f0000, setting cluster-up flag (Was=false) 2023-09-27 00:00:58,050 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 00:00:58,055 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-09-27 00:00:58,057 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,33541,1695772855814 2023-09-27 00:00:58,062 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 00:00:58,069 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-09-27 00:00:58,070 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,33541,1695772855814 2023-09-27 00:00:58,073 WARN [master/jenkins-hbase9:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp 2023-09-27 00:00:58,151 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-09-27 00:00:58,156 INFO [master/jenkins-hbase9:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 00:00:58,156 INFO [master/jenkins-hbase9:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-09-27 00:00:58,162 INFO [RS:1;jenkins-hbase9:41703] regionserver.HRegionServer(951): ClusterId : a177636e-dc85-4587-a5f4-fa8e64a1c0ca 2023-09-27 00:00:58,162 INFO [RS:0;jenkins-hbase9:41869] regionserver.HRegionServer(951): ClusterId : a177636e-dc85-4587-a5f4-fa8e64a1c0ca 2023-09-27 00:00:58,163 INFO [RS:2;jenkins-hbase9:36739] regionserver.HRegionServer(951): ClusterId : a177636e-dc85-4587-a5f4-fa8e64a1c0ca 2023-09-27 00:00:58,168 DEBUG [RS:1;jenkins-hbase9:41703] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-27 00:00:58,168 DEBUG [RS:2;jenkins-hbase9:36739] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-27 00:00:58,168 DEBUG [RS:0;jenkins-hbase9:41869] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-27 00:00:58,176 DEBUG [RS:2;jenkins-hbase9:36739] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-27 00:00:58,176 DEBUG [RS:0;jenkins-hbase9:41869] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-27 00:00:58,176 DEBUG [RS:1;jenkins-hbase9:41703] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-27 00:00:58,176 DEBUG [RS:0;jenkins-hbase9:41869] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-27 00:00:58,176 DEBUG [RS:2;jenkins-hbase9:36739] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-27 00:00:58,176 DEBUG [RS:1;jenkins-hbase9:41703] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-27 00:00:58,182 DEBUG [RS:0;jenkins-hbase9:41869] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-27 00:00:58,182 DEBUG [RS:2;jenkins-hbase9:36739] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-27 00:00:58,184 DEBUG [RS:1;jenkins-hbase9:41703] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-27 00:00:58,185 DEBUG [RS:1;jenkins-hbase9:41703] zookeeper.ReadOnlyZKClient(139): Connect 0x46c2a243 to 127.0.0.1:57983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 00:00:58,186 DEBUG [RS:0;jenkins-hbase9:41869] zookeeper.ReadOnlyZKClient(139): Connect 0x0bd8602b to 127.0.0.1:57983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 00:00:58,187 DEBUG [RS:2;jenkins-hbase9:36739] zookeeper.ReadOnlyZKClient(139): Connect 0x4c945755 to 127.0.0.1:57983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 00:00:58,194 DEBUG [RS:0;jenkins-hbase9:41869] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@51f8f20, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 00:00:58,194 DEBUG [RS:0;jenkins-hbase9:41869] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1200b5b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-09-27 00:00:58,195 DEBUG [RS:1;jenkins-hbase9:41703] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@480554eb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 00:00:58,196 DEBUG [RS:1;jenkins-hbase9:41703] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c3ac933, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-09-27 00:00:58,231 DEBUG [RS:2;jenkins-hbase9:36739] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4253b0b7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 00:00:58,231 DEBUG [RS:2;jenkins-hbase9:36739] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@36eba8c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-09-27 00:00:58,251 DEBUG [RS:1;jenkins-hbase9:41703] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase9:41703 2023-09-27 00:00:58,251 DEBUG [RS:2;jenkins-hbase9:36739] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase9:36739 2023-09-27 00:00:58,255 DEBUG [RS:0;jenkins-hbase9:41869] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase9:41869 2023-09-27 00:00:58,255 INFO [RS:1;jenkins-hbase9:41703] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-27 00:00:58,256 INFO [RS:2;jenkins-hbase9:36739] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-27 00:00:58,256 INFO [RS:0;jenkins-hbase9:41869] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-27 00:00:58,256 INFO [RS:1;jenkins-hbase9:41703] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-27 00:00:58,256 INFO [RS:0;jenkins-hbase9:41869] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-27 00:00:58,256 INFO [RS:2;jenkins-hbase9:36739] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-27 00:00:58,257 DEBUG [RS:1;jenkins-hbase9:41703] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-27 00:00:58,257 DEBUG [RS:2;jenkins-hbase9:36739] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-27 00:00:58,257 DEBUG [RS:0;jenkins-hbase9:41869] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-27 00:00:58,258 INFO [RS:1;jenkins-hbase9:41703] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 00:00:58,258 INFO [RS:2;jenkins-hbase9:36739] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 00:00:58,258 DEBUG [RS:2;jenkins-hbase9:36739] regionserver.HRegionServer(1022): About to register with Master. 2023-09-27 00:00:58,258 INFO [RS:0;jenkins-hbase9:41869] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 00:00:58,258 DEBUG [RS:0;jenkins-hbase9:41869] regionserver.HRegionServer(1022): About to register with Master. 2023-09-27 00:00:58,258 DEBUG [RS:1;jenkins-hbase9:41703] regionserver.HRegionServer(1022): About to register with Master. 2023-09-27 00:00:58,261 INFO [RS:0;jenkins-hbase9:41869] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,33541,1695772855814 with isa=jenkins-hbase9.apache.org/172.31.2.10:41869, startcode=1695772857056 2023-09-27 00:00:58,261 INFO [RS:2;jenkins-hbase9:36739] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,33541,1695772855814 with isa=jenkins-hbase9.apache.org/172.31.2.10:36739, startcode=1695772857140 2023-09-27 00:00:58,261 INFO [RS:1;jenkins-hbase9:41703] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,33541,1695772855814 with isa=jenkins-hbase9.apache.org/172.31.2.10:41703, startcode=1695772857103 2023-09-27 00:00:58,272 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-09-27 00:00:58,279 DEBUG [RS:2;jenkins-hbase9:36739] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-27 00:00:58,279 DEBUG [RS:1;jenkins-hbase9:41703] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-27 00:00:58,279 DEBUG [RS:0;jenkins-hbase9:41869] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-27 00:00:58,283 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-09-27 00:00:58,283 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-09-27 00:00:58,283 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-09-27 00:00:58,283 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-09-27 00:00:58,284 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase9:0, corePoolSize=10, maxPoolSize=10 2023-09-27 00:00:58,284 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 00:00:58,284 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-09-27 00:00:58,284 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 00:00:58,285 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1695772888285 2023-09-27 00:00:58,287 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-09-27 00:00:58,292 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-09-27 00:00:58,292 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-09-27 00:00:58,297 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-27 00:00:58,298 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-09-27 00:00:58,307 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-09-27 00:00:58,307 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-09-27 00:00:58,308 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-09-27 00:00:58,308 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-09-27 00:00:58,310 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-27 00:00:58,314 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-09-27 00:00:58,317 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-09-27 00:00:58,317 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-09-27 00:00:58,324 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-09-27 00:00:58,325 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-09-27 00:00:58,328 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1695772858327,5,FailOnTimeoutGroup] 2023-09-27 00:00:58,328 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1695772858328,5,FailOnTimeoutGroup] 2023-09-27 00:00:58,328 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-27 00:00:58,328 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-09-27 00:00:58,329 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-09-27 00:00:58,330 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-09-27 00:00:58,352 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:60909, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-09-27 00:00:58,353 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-27 00:00:58,352 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:53865, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-09-27 00:00:58,352 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43549, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-09-27 00:00:58,354 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-27 00:00:58,355 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8 2023-09-27 00:00:58,365 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33541] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:00:58,384 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33541] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:00:58,384 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 00:00:58,386 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33541] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:00:58,390 DEBUG [RS:0;jenkins-hbase9:41869] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8 2023-09-27 00:00:58,390 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-27 00:00:58,390 DEBUG [RS:2;jenkins-hbase9:36739] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8 2023-09-27 00:00:58,390 DEBUG [RS:1;jenkins-hbase9:41703] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8 2023-09-27 00:00:58,391 DEBUG [RS:2;jenkins-hbase9:36739] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:40313 2023-09-27 00:00:58,391 DEBUG [RS:0;jenkins-hbase9:41869] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:40313 2023-09-27 00:00:58,392 DEBUG [RS:2;jenkins-hbase9:36739] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-27 00:00:58,391 DEBUG [RS:1;jenkins-hbase9:41703] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:40313 2023-09-27 00:00:58,392 DEBUG [RS:0;jenkins-hbase9:41869] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-27 00:00:58,392 DEBUG [RS:1;jenkins-hbase9:41703] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-27 00:00:58,394 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/hbase/meta/1588230740/info 2023-09-27 00:00:58,394 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-27 00:00:58,395 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 00:00:58,395 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-27 00:00:58,398 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/hbase/meta/1588230740/rep_barrier 2023-09-27 00:00:58,399 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-27 00:00:58,400 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 00:00:58,400 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-27 00:00:58,402 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/hbase/meta/1588230740/table 2023-09-27 00:00:58,403 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-27 00:00:58,403 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 00:00:58,405 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/hbase/meta/1588230740 2023-09-27 00:00:58,406 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-27 00:00:58,406 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/hbase/meta/1588230740 2023-09-27 00:00:58,407 DEBUG [RS:0;jenkins-hbase9:41869] zookeeper.ZKUtil(162): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:00:58,407 WARN [RS:0;jenkins-hbase9:41869] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-27 00:00:58,407 INFO [RS:0;jenkins-hbase9:41869] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-27 00:00:58,407 DEBUG [RS:1;jenkins-hbase9:41703] zookeeper.ZKUtil(162): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:00:58,408 DEBUG [RS:0;jenkins-hbase9:41869] regionserver.HRegionServer(1948): logDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/WALs/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:00:58,408 WARN [RS:1;jenkins-hbase9:41703] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-27 00:00:58,408 INFO [RS:1;jenkins-hbase9:41703] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-27 00:00:58,409 DEBUG [RS:2;jenkins-hbase9:36739] zookeeper.ZKUtil(162): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:00:58,409 DEBUG [RS:1;jenkins-hbase9:41703] regionserver.HRegionServer(1948): logDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/WALs/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:00:58,409 WARN [RS:2;jenkins-hbase9:36739] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-27 00:00:58,409 INFO [RS:2;jenkins-hbase9:36739] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-27 00:00:58,409 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,41869,1695772857056] 2023-09-27 00:00:58,410 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,41703,1695772857103] 2023-09-27 00:00:58,410 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,36739,1695772857140] 2023-09-27 00:00:58,410 DEBUG [RS:2;jenkins-hbase9:36739] regionserver.HRegionServer(1948): logDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/WALs/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:00:58,415 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-27 00:00:58,420 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-27 00:00:58,424 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 00:00:58,425 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69327342, jitterRate=0.03305789828300476}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-27 00:00:58,425 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-27 00:00:58,425 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-27 00:00:58,425 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-27 00:00:58,425 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-27 00:00:58,425 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-27 00:00:58,425 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-27 00:00:58,426 DEBUG [RS:2;jenkins-hbase9:36739] zookeeper.ZKUtil(162): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:00:58,426 DEBUG [RS:1;jenkins-hbase9:41703] zookeeper.ZKUtil(162): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:00:58,426 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-27 00:00:58,426 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-27 00:00:58,429 DEBUG [RS:1;jenkins-hbase9:41703] zookeeper.ZKUtil(162): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:00:58,429 DEBUG [RS:2;jenkins-hbase9:36739] zookeeper.ZKUtil(162): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:00:58,429 DEBUG [RS:0;jenkins-hbase9:41869] zookeeper.ZKUtil(162): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:00:58,430 DEBUG [RS:1;jenkins-hbase9:41703] zookeeper.ZKUtil(162): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:00:58,432 DEBUG [RS:0;jenkins-hbase9:41869] zookeeper.ZKUtil(162): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:00:58,433 DEBUG [RS:2;jenkins-hbase9:36739] zookeeper.ZKUtil(162): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:00:58,433 DEBUG [RS:0;jenkins-hbase9:41869] zookeeper.ZKUtil(162): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:00:58,433 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-09-27 00:00:58,434 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-09-27 00:00:58,446 DEBUG [RS:0;jenkins-hbase9:41869] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-27 00:00:58,446 DEBUG [RS:2;jenkins-hbase9:36739] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-27 00:00:58,446 DEBUG [RS:1;jenkins-hbase9:41703] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-27 00:00:58,447 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-09-27 00:00:58,456 INFO [RS:2;jenkins-hbase9:36739] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-27 00:00:58,456 INFO [RS:1;jenkins-hbase9:41703] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-27 00:00:58,456 INFO [RS:0;jenkins-hbase9:41869] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-27 00:00:58,463 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-09-27 00:00:58,466 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-09-27 00:00:58,481 INFO [RS:0;jenkins-hbase9:41869] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-27 00:00:58,481 INFO [RS:1;jenkins-hbase9:41703] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-27 00:00:58,481 INFO [RS:2;jenkins-hbase9:36739] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-27 00:00:58,486 INFO [RS:2;jenkins-hbase9:36739] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-27 00:00:58,486 INFO [RS:0;jenkins-hbase9:41869] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-27 00:00:58,486 INFO [RS:2;jenkins-hbase9:36739] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-27 00:00:58,486 INFO [RS:0;jenkins-hbase9:41869] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-27 00:00:58,486 INFO [RS:1;jenkins-hbase9:41703] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-27 00:00:58,487 INFO [RS:1;jenkins-hbase9:41703] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-27 00:00:58,488 INFO [RS:0;jenkins-hbase9:41869] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-27 00:00:58,488 INFO [RS:2;jenkins-hbase9:36739] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-27 00:00:58,488 INFO [RS:1;jenkins-hbase9:41703] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-27 00:00:58,496 INFO [RS:2;jenkins-hbase9:36739] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-27 00:00:58,496 INFO [RS:1;jenkins-hbase9:41703] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-27 00:00:58,496 INFO [RS:0;jenkins-hbase9:41869] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-27 00:00:58,496 DEBUG [RS:2;jenkins-hbase9:36739] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 00:00:58,497 DEBUG [RS:1;jenkins-hbase9:41703] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 00:00:58,497 DEBUG [RS:2;jenkins-hbase9:36739] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 00:00:58,497 DEBUG [RS:0;jenkins-hbase9:41869] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 00:00:58,497 DEBUG [RS:2;jenkins-hbase9:36739] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 00:00:58,497 DEBUG [RS:0;jenkins-hbase9:41869] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 00:00:58,497 DEBUG [RS:2;jenkins-hbase9:36739] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 00:00:58,497 DEBUG [RS:0;jenkins-hbase9:41869] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 00:00:58,497 DEBUG [RS:2;jenkins-hbase9:36739] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 00:00:58,497 DEBUG [RS:0;jenkins-hbase9:41869] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 00:00:58,497 DEBUG [RS:2;jenkins-hbase9:36739] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-09-27 00:00:58,497 DEBUG [RS:1;jenkins-hbase9:41703] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 00:00:58,498 DEBUG [RS:2;jenkins-hbase9:36739] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 00:00:58,498 DEBUG [RS:0;jenkins-hbase9:41869] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 00:00:58,498 DEBUG [RS:2;jenkins-hbase9:36739] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 00:00:58,498 DEBUG [RS:0;jenkins-hbase9:41869] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-09-27 00:00:58,498 DEBUG [RS:2;jenkins-hbase9:36739] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 00:00:58,498 DEBUG [RS:0;jenkins-hbase9:41869] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 00:00:58,498 DEBUG [RS:2;jenkins-hbase9:36739] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 00:00:58,498 DEBUG [RS:0;jenkins-hbase9:41869] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 00:00:58,498 DEBUG [RS:1;jenkins-hbase9:41703] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 00:00:58,498 DEBUG [RS:0;jenkins-hbase9:41869] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 00:00:58,498 DEBUG [RS:0;jenkins-hbase9:41869] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 00:00:58,498 DEBUG [RS:1;jenkins-hbase9:41703] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 00:00:58,499 DEBUG [RS:1;jenkins-hbase9:41703] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 00:00:58,499 DEBUG [RS:1;jenkins-hbase9:41703] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-09-27 00:00:58,500 DEBUG [RS:1;jenkins-hbase9:41703] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 00:00:58,500 DEBUG [RS:1;jenkins-hbase9:41703] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 00:00:58,500 DEBUG [RS:1;jenkins-hbase9:41703] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 00:00:58,500 DEBUG [RS:1;jenkins-hbase9:41703] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 00:00:58,500 INFO [RS:2;jenkins-hbase9:36739] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-27 00:00:58,500 INFO [RS:2;jenkins-hbase9:36739] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-27 00:00:58,500 INFO [RS:2;jenkins-hbase9:36739] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-27 00:00:58,501 INFO [RS:0;jenkins-hbase9:41869] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-27 00:00:58,501 INFO [RS:0;jenkins-hbase9:41869] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-27 00:00:58,501 INFO [RS:0;jenkins-hbase9:41869] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-27 00:00:58,508 INFO [RS:1;jenkins-hbase9:41703] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-27 00:00:58,508 INFO [RS:1;jenkins-hbase9:41703] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-27 00:00:58,508 INFO [RS:1;jenkins-hbase9:41703] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-27 00:00:58,523 INFO [RS:2;jenkins-hbase9:36739] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-27 00:00:58,523 INFO [RS:1;jenkins-hbase9:41703] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-27 00:00:58,523 INFO [RS:0;jenkins-hbase9:41869] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-27 00:00:58,527 INFO [RS:0;jenkins-hbase9:41869] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,41869,1695772857056-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-27 00:00:58,527 INFO [RS:1;jenkins-hbase9:41703] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,41703,1695772857103-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-27 00:00:58,527 INFO [RS:2;jenkins-hbase9:36739] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,36739,1695772857140-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-27 00:00:58,548 INFO [RS:0;jenkins-hbase9:41869] regionserver.Replication(203): jenkins-hbase9.apache.org,41869,1695772857056 started 2023-09-27 00:00:58,548 INFO [RS:1;jenkins-hbase9:41703] regionserver.Replication(203): jenkins-hbase9.apache.org,41703,1695772857103 started 2023-09-27 00:00:58,548 INFO [RS:0;jenkins-hbase9:41869] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,41869,1695772857056, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:41869, sessionid=0x100eaa1be8f0001 2023-09-27 00:00:58,548 INFO [RS:1;jenkins-hbase9:41703] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,41703,1695772857103, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:41703, sessionid=0x100eaa1be8f0002 2023-09-27 00:00:58,548 DEBUG [RS:0;jenkins-hbase9:41869] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-27 00:00:58,548 DEBUG [RS:1;jenkins-hbase9:41703] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-27 00:00:58,548 DEBUG [RS:0;jenkins-hbase9:41869] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:00:58,549 DEBUG [RS:1;jenkins-hbase9:41703] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:00:58,549 DEBUG [RS:0;jenkins-hbase9:41869] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,41869,1695772857056' 2023-09-27 00:00:58,549 DEBUG [RS:1;jenkins-hbase9:41703] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,41703,1695772857103' 2023-09-27 00:00:58,550 DEBUG [RS:0;jenkins-hbase9:41869] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-27 00:00:58,550 DEBUG [RS:1;jenkins-hbase9:41703] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-27 00:00:58,551 DEBUG [RS:0;jenkins-hbase9:41869] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-27 00:00:58,551 DEBUG [RS:1;jenkins-hbase9:41703] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-27 00:00:58,551 DEBUG [RS:0;jenkins-hbase9:41869] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-27 00:00:58,551 DEBUG [RS:1;jenkins-hbase9:41703] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-27 00:00:58,552 DEBUG [RS:1;jenkins-hbase9:41703] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-27 00:00:58,551 DEBUG [RS:0;jenkins-hbase9:41869] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-27 00:00:58,552 DEBUG [RS:1;jenkins-hbase9:41703] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:00:58,552 DEBUG [RS:0;jenkins-hbase9:41869] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:00:58,552 DEBUG [RS:1;jenkins-hbase9:41703] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,41703,1695772857103' 2023-09-27 00:00:58,552 DEBUG [RS:1;jenkins-hbase9:41703] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:00:58,552 DEBUG [RS:0;jenkins-hbase9:41869] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,41869,1695772857056' 2023-09-27 00:00:58,552 DEBUG [RS:0;jenkins-hbase9:41869] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:00:58,553 DEBUG [RS:1;jenkins-hbase9:41703] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:00:58,553 DEBUG [RS:0;jenkins-hbase9:41869] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:00:58,553 DEBUG [RS:1;jenkins-hbase9:41703] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-27 00:00:58,554 DEBUG [RS:0;jenkins-hbase9:41869] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-27 00:00:58,554 INFO [RS:1;jenkins-hbase9:41703] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-27 00:00:58,554 INFO [RS:2;jenkins-hbase9:36739] regionserver.Replication(203): jenkins-hbase9.apache.org,36739,1695772857140 started 2023-09-27 00:00:58,554 INFO [RS:1;jenkins-hbase9:41703] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-27 00:00:58,554 INFO [RS:0;jenkins-hbase9:41869] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-27 00:00:58,554 INFO [RS:2;jenkins-hbase9:36739] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,36739,1695772857140, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:36739, sessionid=0x100eaa1be8f0003 2023-09-27 00:00:58,555 INFO [RS:0;jenkins-hbase9:41869] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-27 00:00:58,555 DEBUG [RS:2;jenkins-hbase9:36739] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-27 00:00:58,555 DEBUG [RS:2;jenkins-hbase9:36739] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:00:58,555 DEBUG [RS:2;jenkins-hbase9:36739] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,36739,1695772857140' 2023-09-27 00:00:58,555 DEBUG [RS:2;jenkins-hbase9:36739] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-27 00:00:58,556 DEBUG [RS:2;jenkins-hbase9:36739] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-27 00:00:58,556 DEBUG [RS:2;jenkins-hbase9:36739] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-27 00:00:58,556 DEBUG [RS:2;jenkins-hbase9:36739] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-27 00:00:58,557 DEBUG [RS:2;jenkins-hbase9:36739] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:00:58,557 DEBUG [RS:2;jenkins-hbase9:36739] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,36739,1695772857140' 2023-09-27 00:00:58,557 DEBUG [RS:2;jenkins-hbase9:36739] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:00:58,557 DEBUG [RS:2;jenkins-hbase9:36739] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:00:58,558 DEBUG [RS:2;jenkins-hbase9:36739] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-27 00:00:58,558 INFO [RS:2;jenkins-hbase9:36739] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-27 00:00:58,558 INFO [RS:2;jenkins-hbase9:36739] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-27 00:00:58,618 DEBUG [jenkins-hbase9:33541] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-09-27 00:00:58,622 DEBUG [jenkins-hbase9:33541] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-09-27 00:00:58,628 DEBUG [jenkins-hbase9:33541] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 00:00:58,628 DEBUG [jenkins-hbase9:33541] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 00:00:58,628 DEBUG [jenkins-hbase9:33541] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 00:00:58,628 DEBUG [jenkins-hbase9:33541] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 00:00:58,632 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,41869,1695772857056, state=OPENING 2023-09-27 00:00:58,641 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-09-27 00:00:58,644 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 00:00:58,644 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-27 00:00:58,649 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,41869,1695772857056}] 2023-09-27 00:00:58,667 INFO [RS:0;jenkins-hbase9:41869] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C41869%2C1695772857056, suffix=, logDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/WALs/jenkins-hbase9.apache.org,41869,1695772857056, archiveDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/oldWALs, maxLogs=32 2023-09-27 00:00:58,667 INFO [RS:1;jenkins-hbase9:41703] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C41703%2C1695772857103, suffix=, logDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/WALs/jenkins-hbase9.apache.org,41703,1695772857103, archiveDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/oldWALs, maxLogs=32 2023-09-27 00:00:58,667 INFO [RS:2;jenkins-hbase9:36739] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C36739%2C1695772857140, suffix=, logDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/WALs/jenkins-hbase9.apache.org,36739,1695772857140, archiveDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/oldWALs, maxLogs=32 2023-09-27 00:00:58,697 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40009,DS-98c4e38d-cad1-4038-845f-b4f7d1c16be1,DISK] 2023-09-27 00:00:58,701 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41377,DS-57fb5dbe-d6d3-4d17-9108-e0bf8b6598ae,DISK] 2023-09-27 00:00:58,701 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40009,DS-98c4e38d-cad1-4038-845f-b4f7d1c16be1,DISK] 2023-09-27 00:00:58,702 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35499,DS-d2e51846-6c95-4dbe-8e75-3c098e734cf6,DISK] 2023-09-27 00:00:58,702 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41377,DS-57fb5dbe-d6d3-4d17-9108-e0bf8b6598ae,DISK] 2023-09-27 00:00:58,702 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35499,DS-d2e51846-6c95-4dbe-8e75-3c098e734cf6,DISK] 2023-09-27 00:00:58,703 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41377,DS-57fb5dbe-d6d3-4d17-9108-e0bf8b6598ae,DISK] 2023-09-27 00:00:58,703 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40009,DS-98c4e38d-cad1-4038-845f-b4f7d1c16be1,DISK] 2023-09-27 00:00:58,703 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35499,DS-d2e51846-6c95-4dbe-8e75-3c098e734cf6,DISK] 2023-09-27 00:00:58,718 INFO [RS:0;jenkins-hbase9:41869] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/WALs/jenkins-hbase9.apache.org,41869,1695772857056/jenkins-hbase9.apache.org%2C41869%2C1695772857056.1695772858672 2023-09-27 00:00:58,718 INFO [RS:2;jenkins-hbase9:36739] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/WALs/jenkins-hbase9.apache.org,36739,1695772857140/jenkins-hbase9.apache.org%2C36739%2C1695772857140.1695772858672 2023-09-27 00:00:58,718 INFO [RS:1;jenkins-hbase9:41703] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/WALs/jenkins-hbase9.apache.org,41703,1695772857103/jenkins-hbase9.apache.org%2C41703%2C1695772857103.1695772858672 2023-09-27 00:00:58,719 DEBUG [RS:0;jenkins-hbase9:41869] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41377,DS-57fb5dbe-d6d3-4d17-9108-e0bf8b6598ae,DISK], DatanodeInfoWithStorage[127.0.0.1:40009,DS-98c4e38d-cad1-4038-845f-b4f7d1c16be1,DISK], DatanodeInfoWithStorage[127.0.0.1:35499,DS-d2e51846-6c95-4dbe-8e75-3c098e734cf6,DISK]] 2023-09-27 00:00:58,720 DEBUG [RS:2;jenkins-hbase9:36739] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40009,DS-98c4e38d-cad1-4038-845f-b4f7d1c16be1,DISK], DatanodeInfoWithStorage[127.0.0.1:35499,DS-d2e51846-6c95-4dbe-8e75-3c098e734cf6,DISK], DatanodeInfoWithStorage[127.0.0.1:41377,DS-57fb5dbe-d6d3-4d17-9108-e0bf8b6598ae,DISK]] 2023-09-27 00:00:58,720 DEBUG [RS:1;jenkins-hbase9:41703] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40009,DS-98c4e38d-cad1-4038-845f-b4f7d1c16be1,DISK], DatanodeInfoWithStorage[127.0.0.1:35499,DS-d2e51846-6c95-4dbe-8e75-3c098e734cf6,DISK], DatanodeInfoWithStorage[127.0.0.1:41377,DS-57fb5dbe-d6d3-4d17-9108-e0bf8b6598ae,DISK]] 2023-09-27 00:00:58,835 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:00:58,837 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-27 00:00:58,842 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:60640, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-27 00:00:58,854 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-09-27 00:00:58,854 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-27 00:00:58,858 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C41869%2C1695772857056.meta, suffix=.meta, logDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/WALs/jenkins-hbase9.apache.org,41869,1695772857056, archiveDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/oldWALs, maxLogs=32 2023-09-27 00:00:58,877 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35499,DS-d2e51846-6c95-4dbe-8e75-3c098e734cf6,DISK] 2023-09-27 00:00:58,877 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41377,DS-57fb5dbe-d6d3-4d17-9108-e0bf8b6598ae,DISK] 2023-09-27 00:00:58,878 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40009,DS-98c4e38d-cad1-4038-845f-b4f7d1c16be1,DISK] 2023-09-27 00:00:58,883 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/WALs/jenkins-hbase9.apache.org,41869,1695772857056/jenkins-hbase9.apache.org%2C41869%2C1695772857056.meta.1695772858859.meta 2023-09-27 00:00:58,883 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35499,DS-d2e51846-6c95-4dbe-8e75-3c098e734cf6,DISK], DatanodeInfoWithStorage[127.0.0.1:41377,DS-57fb5dbe-d6d3-4d17-9108-e0bf8b6598ae,DISK], DatanodeInfoWithStorage[127.0.0.1:40009,DS-98c4e38d-cad1-4038-845f-b4f7d1c16be1,DISK]] 2023-09-27 00:00:58,884 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-09-27 00:00:58,885 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-09-27 00:00:58,887 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 00:00:58,887 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-09-27 00:00:58,889 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-09-27 00:00:58,891 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-09-27 00:00:58,904 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-09-27 00:00:58,904 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 00:00:58,905 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-09-27 00:00:58,905 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-09-27 00:00:58,908 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-27 00:00:58,909 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/hbase/meta/1588230740/info 2023-09-27 00:00:58,909 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/hbase/meta/1588230740/info 2023-09-27 00:00:58,910 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-27 00:00:58,911 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 00:00:58,911 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-27 00:00:58,912 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/hbase/meta/1588230740/rep_barrier 2023-09-27 00:00:58,912 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/hbase/meta/1588230740/rep_barrier 2023-09-27 00:00:58,913 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-27 00:00:58,914 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 00:00:58,914 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-27 00:00:58,915 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/hbase/meta/1588230740/table 2023-09-27 00:00:58,915 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/hbase/meta/1588230740/table 2023-09-27 00:00:58,916 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-27 00:00:58,916 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 00:00:58,918 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/hbase/meta/1588230740 2023-09-27 00:00:58,922 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/hbase/meta/1588230740 2023-09-27 00:00:58,925 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-27 00:00:58,927 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-27 00:00:58,929 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71687791, jitterRate=0.06823132932186127}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-27 00:00:58,931 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-27 00:00:58,947 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1695772858827 2023-09-27 00:00:58,968 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-09-27 00:00:58,970 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-09-27 00:00:58,971 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,41869,1695772857056, state=OPEN 2023-09-27 00:00:58,974 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-09-27 00:00:58,974 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-27 00:00:58,979 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-09-27 00:00:58,979 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,41869,1695772857056 in 325 msec 2023-09-27 00:00:58,984 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-09-27 00:00:58,984 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 534 msec 2023-09-27 00:00:58,990 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 825 msec 2023-09-27 00:00:58,990 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1695772858990, completionTime=-1 2023-09-27 00:00:58,990 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-09-27 00:00:58,990 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-09-27 00:00:59,061 DEBUG [hconnection-0x49a14021-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 00:00:59,064 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:60652, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 00:00:59,084 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-09-27 00:00:59,084 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1695772919084 2023-09-27 00:00:59,084 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1695772979084 2023-09-27 00:00:59,084 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 93 msec 2023-09-27 00:00:59,107 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,33541,1695772855814-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-27 00:00:59,107 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,33541,1695772855814-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-27 00:00:59,108 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,33541,1695772855814-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-27 00:00:59,109 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase9:33541, period=300000, unit=MILLISECONDS is enabled. 2023-09-27 00:00:59,110 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-09-27 00:00:59,119 DEBUG [master/jenkins-hbase9:0.Chore.1] janitor.CatalogJanitor(175): 2023-09-27 00:00:59,128 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-09-27 00:00:59,129 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-27 00:00:59,139 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-09-27 00:00:59,141 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-09-27 00:00:59,144 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-27 00:00:59,167 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/hbase/namespace/4e820a82ca89c8ef3cf272c45cf6afe2 2023-09-27 00:00:59,171 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/hbase/namespace/4e820a82ca89c8ef3cf272c45cf6afe2 empty. 2023-09-27 00:00:59,171 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/hbase/namespace/4e820a82ca89c8ef3cf272c45cf6afe2 2023-09-27 00:00:59,171 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-09-27 00:00:59,205 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-09-27 00:00:59,207 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4e820a82ca89c8ef3cf272c45cf6afe2, NAME => 'hbase:namespace,,1695772859129.4e820a82ca89c8ef3cf272c45cf6afe2.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp 2023-09-27 00:00:59,225 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695772859129.4e820a82ca89c8ef3cf272c45cf6afe2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 00:00:59,225 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 4e820a82ca89c8ef3cf272c45cf6afe2, disabling compactions & flushes 2023-09-27 00:00:59,225 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695772859129.4e820a82ca89c8ef3cf272c45cf6afe2. 2023-09-27 00:00:59,225 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695772859129.4e820a82ca89c8ef3cf272c45cf6afe2. 2023-09-27 00:00:59,225 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695772859129.4e820a82ca89c8ef3cf272c45cf6afe2. after waiting 0 ms 2023-09-27 00:00:59,225 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695772859129.4e820a82ca89c8ef3cf272c45cf6afe2. 2023-09-27 00:00:59,225 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695772859129.4e820a82ca89c8ef3cf272c45cf6afe2. 2023-09-27 00:00:59,226 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 4e820a82ca89c8ef3cf272c45cf6afe2: 2023-09-27 00:00:59,230 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-09-27 00:00:59,244 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1695772859129.4e820a82ca89c8ef3cf272c45cf6afe2.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695772859232"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695772859232"}]},"ts":"1695772859232"} 2023-09-27 00:00:59,272 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-27 00:00:59,274 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-27 00:00:59,278 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695772859274"}]},"ts":"1695772859274"} 2023-09-27 00:00:59,284 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-09-27 00:00:59,289 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-09-27 00:00:59,290 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 00:00:59,290 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 00:00:59,290 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 00:00:59,290 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 00:00:59,293 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4e820a82ca89c8ef3cf272c45cf6afe2, ASSIGN}] 2023-09-27 00:00:59,296 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4e820a82ca89c8ef3cf272c45cf6afe2, ASSIGN 2023-09-27 00:00:59,297 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=4e820a82ca89c8ef3cf272c45cf6afe2, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,41703,1695772857103; forceNewPlan=false, retain=false 2023-09-27 00:00:59,449 INFO [jenkins-hbase9:33541] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-27 00:00:59,451 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4e820a82ca89c8ef3cf272c45cf6afe2, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:00:59,451 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1695772859129.4e820a82ca89c8ef3cf272c45cf6afe2.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695772859450"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695772859450"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695772859450"}]},"ts":"1695772859450"} 2023-09-27 00:00:59,456 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 4e820a82ca89c8ef3cf272c45cf6afe2, server=jenkins-hbase9.apache.org,41703,1695772857103}] 2023-09-27 00:00:59,611 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:00:59,612 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-27 00:00:59,616 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35802, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-27 00:00:59,622 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1695772859129.4e820a82ca89c8ef3cf272c45cf6afe2. 2023-09-27 00:00:59,624 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4e820a82ca89c8ef3cf272c45cf6afe2, NAME => 'hbase:namespace,,1695772859129.4e820a82ca89c8ef3cf272c45cf6afe2.', STARTKEY => '', ENDKEY => ''} 2023-09-27 00:00:59,624 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1695772859129.4e820a82ca89c8ef3cf272c45cf6afe2. service=AccessControlService 2023-09-27 00:00:59,625 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 00:00:59,625 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 4e820a82ca89c8ef3cf272c45cf6afe2 2023-09-27 00:00:59,625 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695772859129.4e820a82ca89c8ef3cf272c45cf6afe2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 00:00:59,625 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 4e820a82ca89c8ef3cf272c45cf6afe2 2023-09-27 00:00:59,625 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 4e820a82ca89c8ef3cf272c45cf6afe2 2023-09-27 00:00:59,627 INFO [StoreOpener-4e820a82ca89c8ef3cf272c45cf6afe2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 4e820a82ca89c8ef3cf272c45cf6afe2 2023-09-27 00:00:59,629 DEBUG [StoreOpener-4e820a82ca89c8ef3cf272c45cf6afe2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/hbase/namespace/4e820a82ca89c8ef3cf272c45cf6afe2/info 2023-09-27 00:00:59,630 DEBUG [StoreOpener-4e820a82ca89c8ef3cf272c45cf6afe2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/hbase/namespace/4e820a82ca89c8ef3cf272c45cf6afe2/info 2023-09-27 00:00:59,630 INFO [StoreOpener-4e820a82ca89c8ef3cf272c45cf6afe2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4e820a82ca89c8ef3cf272c45cf6afe2 columnFamilyName info 2023-09-27 00:00:59,631 INFO [StoreOpener-4e820a82ca89c8ef3cf272c45cf6afe2-1] regionserver.HStore(310): Store=4e820a82ca89c8ef3cf272c45cf6afe2/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 00:00:59,632 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/hbase/namespace/4e820a82ca89c8ef3cf272c45cf6afe2 2023-09-27 00:00:59,633 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/hbase/namespace/4e820a82ca89c8ef3cf272c45cf6afe2 2023-09-27 00:00:59,638 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 4e820a82ca89c8ef3cf272c45cf6afe2 2023-09-27 00:00:59,641 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/hbase/namespace/4e820a82ca89c8ef3cf272c45cf6afe2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 00:00:59,642 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 4e820a82ca89c8ef3cf272c45cf6afe2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71299600, jitterRate=0.06244683265686035}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 00:00:59,642 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 4e820a82ca89c8ef3cf272c45cf6afe2: 2023-09-27 00:00:59,644 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1695772859129.4e820a82ca89c8ef3cf272c45cf6afe2., pid=6, masterSystemTime=1695772859611 2023-09-27 00:00:59,648 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1695772859129.4e820a82ca89c8ef3cf272c45cf6afe2. 2023-09-27 00:00:59,648 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1695772859129.4e820a82ca89c8ef3cf272c45cf6afe2. 2023-09-27 00:00:59,650 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4e820a82ca89c8ef3cf272c45cf6afe2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:00:59,650 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1695772859129.4e820a82ca89c8ef3cf272c45cf6afe2.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695772859649"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695772859649"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695772859649"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695772859649"}]},"ts":"1695772859649"} 2023-09-27 00:00:59,657 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-09-27 00:00:59,657 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 4e820a82ca89c8ef3cf272c45cf6afe2, server=jenkins-hbase9.apache.org,41703,1695772857103 in 197 msec 2023-09-27 00:00:59,661 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-09-27 00:00:59,661 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=4e820a82ca89c8ef3cf272c45cf6afe2, ASSIGN in 364 msec 2023-09-27 00:00:59,662 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-27 00:00:59,663 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695772859663"}]},"ts":"1695772859663"} 2023-09-27 00:00:59,665 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-09-27 00:00:59,668 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-09-27 00:00:59,671 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 539 msec 2023-09-27 00:00:59,742 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-09-27 00:00:59,743 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-09-27 00:00:59,743 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 00:00:59,764 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 00:00:59,767 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35808, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 00:00:59,779 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-09-27 00:00:59,796 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-27 00:00:59,802 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 29 msec 2023-09-27 00:00:59,813 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-09-27 00:00:59,824 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-27 00:00:59,829 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 15 msec 2023-09-27 00:00:59,839 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-09-27 00:00:59,842 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-09-27 00:00:59,842 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.643sec 2023-09-27 00:00:59,845 INFO [master/jenkins-hbase9:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-09-27 00:00:59,847 INFO [master/jenkins-hbase9:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-09-27 00:00:59,847 INFO [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-09-27 00:00:59,848 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,33541,1695772855814-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-09-27 00:00:59,848 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,33541,1695772855814-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-09-27 00:00:59,867 DEBUG [Listener at localhost/37551] zookeeper.ReadOnlyZKClient(139): Connect 0x52492d35 to 127.0.0.1:57983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 00:00:59,870 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-27 00:00:59,872 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-09-27 00:00:59,874 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-09-27 00:00:59,874 DEBUG [Listener at localhost/37551] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@627146cd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 00:00:59,875 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-27 00:00:59,879 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/hbase/acl/cbc027ae1d474285c288d6078456fdb6 2023-09-27 00:00:59,879 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-09-27 00:00:59,880 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/hbase/acl/cbc027ae1d474285c288d6078456fdb6 empty. 2023-09-27 00:00:59,882 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/hbase/acl/cbc027ae1d474285c288d6078456fdb6 2023-09-27 00:00:59,882 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-09-27 00:00:59,888 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-27 00:00:59,894 DEBUG [hconnection-0x3ca857b3-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 00:00:59,912 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:60660, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 00:00:59,915 INFO [Listener at localhost/37551] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase9.apache.org,33541,1695772855814 2023-09-27 00:00:59,915 INFO [Listener at localhost/37551] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-09-27 00:00:59,916 INFO [Listener at localhost/37551] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/test.cache.data in system properties and HBase conf 2023-09-27 00:00:59,916 INFO [Listener at localhost/37551] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/hadoop.tmp.dir in system properties and HBase conf 2023-09-27 00:00:59,916 INFO [Listener at localhost/37551] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/hadoop.log.dir in system properties and HBase conf 2023-09-27 00:00:59,916 INFO [Listener at localhost/37551] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-27 00:00:59,916 INFO [Listener at localhost/37551] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-27 00:00:59,916 INFO [Listener at localhost/37551] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-27 00:00:59,916 INFO [Listener at localhost/37551] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-27 00:00:59,916 INFO [Listener at localhost/37551] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-27 00:00:59,916 INFO [Listener at localhost/37551] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-27 00:00:59,916 INFO [Listener at localhost/37551] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-27 00:00:59,917 INFO [Listener at localhost/37551] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-27 00:00:59,917 INFO [Listener at localhost/37551] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-27 00:00:59,917 INFO [Listener at localhost/37551] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-27 00:00:59,917 INFO [Listener at localhost/37551] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-27 00:00:59,917 INFO [Listener at localhost/37551] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-27 00:00:59,917 INFO [Listener at localhost/37551] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/nfs.dump.dir in system properties and HBase conf 2023-09-27 00:00:59,917 INFO [Listener at localhost/37551] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/java.io.tmpdir in system properties and HBase conf 2023-09-27 00:00:59,917 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-09-27 00:00:59,917 INFO [Listener at localhost/37551] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-27 00:00:59,917 INFO [Listener at localhost/37551] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-27 00:00:59,917 INFO [Listener at localhost/37551] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-09-27 00:00:59,919 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => cbc027ae1d474285c288d6078456fdb6, NAME => 'hbase:acl,,1695772859864.cbc027ae1d474285c288d6078456fdb6.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp 2023-09-27 00:00:59,944 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695772859864.cbc027ae1d474285c288d6078456fdb6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 00:00:59,944 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing cbc027ae1d474285c288d6078456fdb6, disabling compactions & flushes 2023-09-27 00:00:59,944 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695772859864.cbc027ae1d474285c288d6078456fdb6. 2023-09-27 00:00:59,944 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695772859864.cbc027ae1d474285c288d6078456fdb6. 2023-09-27 00:00:59,944 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695772859864.cbc027ae1d474285c288d6078456fdb6. after waiting 0 ms 2023-09-27 00:00:59,944 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695772859864.cbc027ae1d474285c288d6078456fdb6. 2023-09-27 00:00:59,944 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1695772859864.cbc027ae1d474285c288d6078456fdb6. 2023-09-27 00:00:59,944 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for cbc027ae1d474285c288d6078456fdb6: 2023-09-27 00:00:59,951 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-09-27 00:00:59,953 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1695772859864.cbc027ae1d474285c288d6078456fdb6.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695772859952"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695772859952"}]},"ts":"1695772859952"} 2023-09-27 00:00:59,956 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-27 00:00:59,957 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-27 00:00:59,958 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695772859957"}]},"ts":"1695772859957"} 2023-09-27 00:00:59,961 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-09-27 00:00:59,966 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-09-27 00:00:59,968 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 00:00:59,968 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 00:00:59,968 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 00:00:59,968 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 00:00:59,968 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=cbc027ae1d474285c288d6078456fdb6, ASSIGN}] 2023-09-27 00:00:59,970 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=cbc027ae1d474285c288d6078456fdb6, ASSIGN 2023-09-27 00:00:59,974 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=cbc027ae1d474285c288d6078456fdb6, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,41869,1695772857056; forceNewPlan=false, retain=false 2023-09-27 00:00:59,993 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-27 00:01:00,125 INFO [jenkins-hbase9:33541] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-27 00:01:00,126 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=cbc027ae1d474285c288d6078456fdb6, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:00,126 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1695772859864.cbc027ae1d474285c288d6078456fdb6.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695772860126"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695772860126"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695772860126"}]},"ts":"1695772860126"} 2023-09-27 00:01:00,129 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure cbc027ae1d474285c288d6078456fdb6, server=jenkins-hbase9.apache.org,41869,1695772857056}] 2023-09-27 00:01:00,193 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-27 00:01:00,289 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1695772859864.cbc027ae1d474285c288d6078456fdb6. 2023-09-27 00:01:00,290 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cbc027ae1d474285c288d6078456fdb6, NAME => 'hbase:acl,,1695772859864.cbc027ae1d474285c288d6078456fdb6.', STARTKEY => '', ENDKEY => ''} 2023-09-27 00:01:00,290 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1695772859864.cbc027ae1d474285c288d6078456fdb6. service=AccessControlService 2023-09-27 00:01:00,290 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 00:01:00,290 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl cbc027ae1d474285c288d6078456fdb6 2023-09-27 00:01:00,291 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695772859864.cbc027ae1d474285c288d6078456fdb6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 00:01:00,291 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for cbc027ae1d474285c288d6078456fdb6 2023-09-27 00:01:00,291 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for cbc027ae1d474285c288d6078456fdb6 2023-09-27 00:01:00,294 INFO [StoreOpener-cbc027ae1d474285c288d6078456fdb6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region cbc027ae1d474285c288d6078456fdb6 2023-09-27 00:01:00,296 DEBUG [StoreOpener-cbc027ae1d474285c288d6078456fdb6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/hbase/acl/cbc027ae1d474285c288d6078456fdb6/l 2023-09-27 00:01:00,296 DEBUG [StoreOpener-cbc027ae1d474285c288d6078456fdb6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/hbase/acl/cbc027ae1d474285c288d6078456fdb6/l 2023-09-27 00:01:00,296 INFO [StoreOpener-cbc027ae1d474285c288d6078456fdb6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cbc027ae1d474285c288d6078456fdb6 columnFamilyName l 2023-09-27 00:01:00,297 INFO [StoreOpener-cbc027ae1d474285c288d6078456fdb6-1] regionserver.HStore(310): Store=cbc027ae1d474285c288d6078456fdb6/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 00:01:00,299 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/hbase/acl/cbc027ae1d474285c288d6078456fdb6 2023-09-27 00:01:00,300 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/hbase/acl/cbc027ae1d474285c288d6078456fdb6 2023-09-27 00:01:00,304 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for cbc027ae1d474285c288d6078456fdb6 2023-09-27 00:01:00,308 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/hbase/acl/cbc027ae1d474285c288d6078456fdb6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 00:01:00,309 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened cbc027ae1d474285c288d6078456fdb6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73845703, jitterRate=0.10038672387599945}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 00:01:00,309 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for cbc027ae1d474285c288d6078456fdb6: 2023-09-27 00:01:00,310 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1695772859864.cbc027ae1d474285c288d6078456fdb6., pid=11, masterSystemTime=1695772860283 2023-09-27 00:01:00,313 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1695772859864.cbc027ae1d474285c288d6078456fdb6. 2023-09-27 00:01:00,313 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1695772859864.cbc027ae1d474285c288d6078456fdb6. 2023-09-27 00:01:00,314 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=cbc027ae1d474285c288d6078456fdb6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:00,314 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1695772859864.cbc027ae1d474285c288d6078456fdb6.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695772860314"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695772860314"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695772860314"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695772860314"}]},"ts":"1695772860314"} 2023-09-27 00:01:00,320 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-09-27 00:01:00,321 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure cbc027ae1d474285c288d6078456fdb6, server=jenkins-hbase9.apache.org,41869,1695772857056 in 188 msec 2023-09-27 00:01:00,325 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-09-27 00:01:00,325 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=cbc027ae1d474285c288d6078456fdb6, ASSIGN in 353 msec 2023-09-27 00:01:00,326 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-27 00:01:00,326 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695772860326"}]},"ts":"1695772860326"} 2023-09-27 00:01:00,329 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-09-27 00:01:00,335 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-09-27 00:01:00,338 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 465 msec 2023-09-27 00:01:00,493 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-27 00:01:00,493 INFO [master/jenkins-hbase9:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-09-27 00:01:00,502 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-09-27 00:01:01,121 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-27 00:01:01,474 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-09-27 00:01:01,480 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_45957_jobhistory____.3kt94y/webapp 2023-09-27 00:01:01,645 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-09-27 00:01:01,646 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-09-27 00:01:01,646 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-27 00:01:01,649 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-27 00:01:01,732 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 00:01:02,041 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 00:01:02,379 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-09-27 00:01:02,417 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:45957 2023-09-27 00:01:02,618 WARN [Listener at jenkins-hbase9.apache.org/36863] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-27 00:01:02,864 WARN [Listener at jenkins-hbase9.apache.org/36863] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-27 00:01:02,864 INFO [Listener at jenkins-hbase9.apache.org/36863] log.Slf4jLog(67): jetty-6.1.26 2023-09-27 00:01:02,872 INFO [Listener at jenkins-hbase9.apache.org/36863] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_37409_cluster____.k75gb4/webapp 2023-09-27 00:01:02,938 INFO [Listener at jenkins-hbase9.apache.org/36863] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-09-27 00:01:02,938 INFO [Listener at jenkins-hbase9.apache.org/36863] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-09-27 00:01:02,938 INFO [Listener at jenkins-hbase9.apache.org/36863] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-27 00:01:02,938 INFO [Listener at jenkins-hbase9.apache.org/36863] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-27 00:01:02,947 INFO [Listener at jenkins-hbase9.apache.org/36863] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 00:01:03,141 INFO [Listener at jenkins-hbase9.apache.org/36863] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 00:01:03,266 INFO [Listener at jenkins-hbase9.apache.org/36863] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 00:01:03,276 INFO [Listener at jenkins-hbase9.apache.org/36863] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:37409 2023-09-27 00:01:03,720 WARN [Listener at jenkins-hbase9.apache.org/42911] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-27 00:01:03,743 WARN [Listener at jenkins-hbase9.apache.org/42911] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-27 00:01:03,744 INFO [Listener at jenkins-hbase9.apache.org/42911] log.Slf4jLog(67): jetty-6.1.26 2023-09-27 00:01:03,750 INFO [Listener at jenkins-hbase9.apache.org/42911] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_43033_node____rf5ife/webapp 2023-09-27 00:01:03,800 INFO [Listener at jenkins-hbase9.apache.org/42911] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-27 00:01:03,800 INFO [Listener at jenkins-hbase9.apache.org/42911] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-27 00:01:03,800 INFO [Listener at jenkins-hbase9.apache.org/42911] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-27 00:01:03,800 INFO [Listener at jenkins-hbase9.apache.org/42911] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-27 00:01:03,808 INFO [Listener at jenkins-hbase9.apache.org/42911] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 00:01:03,827 INFO [Listener at jenkins-hbase9.apache.org/42911] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 00:01:03,886 INFO [Listener at jenkins-hbase9.apache.org/42911] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 00:01:03,895 INFO [Listener at jenkins-hbase9.apache.org/42911] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:43033 2023-09-27 00:01:04,100 WARN [Listener at jenkins-hbase9.apache.org/45033] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-27 00:01:04,106 WARN [Listener at jenkins-hbase9.apache.org/45033] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-27 00:01:04,106 INFO [Listener at jenkins-hbase9.apache.org/45033] log.Slf4jLog(67): jetty-6.1.26 2023-09-27 00:01:04,117 INFO [Listener at jenkins-hbase9.apache.org/45033] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_34319_node____.ei7wct/webapp 2023-09-27 00:01:04,166 INFO [Listener at jenkins-hbase9.apache.org/45033] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-27 00:01:04,167 INFO [Listener at jenkins-hbase9.apache.org/45033] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-27 00:01:04,167 INFO [Listener at jenkins-hbase9.apache.org/45033] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-27 00:01:04,167 INFO [Listener at jenkins-hbase9.apache.org/45033] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-27 00:01:04,174 INFO [Listener at jenkins-hbase9.apache.org/45033] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 00:01:04,187 INFO [Listener at jenkins-hbase9.apache.org/45033] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 00:01:04,245 INFO [Listener at jenkins-hbase9.apache.org/45033] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 00:01:04,251 INFO [Listener at jenkins-hbase9.apache.org/45033] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:34319 2023-09-27 00:01:04,273 INFO [Listener at jenkins-hbase9.apache.org/45033] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-09-27 00:01:04,274 INFO [Listener at jenkins-hbase9.apache.org/45033] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 00:01:04,332 INFO [Listener at jenkins-hbase9.apache.org/45033] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=708, OpenFileDescriptor=900, MaxFileDescriptor=60000, SystemLoadAverage=138, ProcessCount=165, AvailableMemoryMB=7666 2023-09-27 00:01:04,332 WARN [Listener at jenkins-hbase9.apache.org/45033] hbase.ResourceChecker(130): Thread=708 is superior to 500 2023-09-27 00:01:04,346 DEBUG [Listener at jenkins-hbase9.apache.org/45033] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-09-27 00:01:04,351 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:57896, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-09-27 00:01:04,357 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-27 00:01:04,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-09-27 00:01:04,361 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-09-27 00:01:04,362 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-09-27 00:01:04,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-27 00:01:04,364 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-27 00:01:04,369 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportWithTargetName/26750b72145befa3c132a2e1cb09fdb3 2023-09-27 00:01:04,369 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportWithTargetName/d5e72453cfbd0391a5f4d754242007a6 2023-09-27 00:01:04,370 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportWithTargetName/26750b72145befa3c132a2e1cb09fdb3 empty. 2023-09-27 00:01:04,370 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportWithTargetName/d5e72453cfbd0391a5f4d754242007a6 empty. 2023-09-27 00:01:04,372 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportWithTargetName/26750b72145befa3c132a2e1cb09fdb3 2023-09-27 00:01:04,372 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportWithTargetName/d5e72453cfbd0391a5f4d754242007a6 2023-09-27 00:01:04,372 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-27 00:01:04,401 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-09-27 00:01:04,403 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => d5e72453cfbd0391a5f4d754242007a6, NAME => 'testtb-testExportWithTargetName,1,1695772864356.d5e72453cfbd0391a5f4d754242007a6.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp 2023-09-27 00:01:04,403 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 26750b72145befa3c132a2e1cb09fdb3, NAME => 'testtb-testExportWithTargetName,,1695772864356.26750b72145befa3c132a2e1cb09fdb3.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp 2023-09-27 00:01:04,434 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695772864356.d5e72453cfbd0391a5f4d754242007a6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 00:01:04,435 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing d5e72453cfbd0391a5f4d754242007a6, disabling compactions & flushes 2023-09-27 00:01:04,435 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695772864356.26750b72145befa3c132a2e1cb09fdb3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 00:01:04,435 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695772864356.d5e72453cfbd0391a5f4d754242007a6. 2023-09-27 00:01:04,436 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 26750b72145befa3c132a2e1cb09fdb3, disabling compactions & flushes 2023-09-27 00:01:04,436 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695772864356.26750b72145befa3c132a2e1cb09fdb3. 2023-09-27 00:01:04,436 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695772864356.d5e72453cfbd0391a5f4d754242007a6. 2023-09-27 00:01:04,436 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695772864356.26750b72145befa3c132a2e1cb09fdb3. 2023-09-27 00:01:04,436 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695772864356.d5e72453cfbd0391a5f4d754242007a6. after waiting 0 ms 2023-09-27 00:01:04,436 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695772864356.26750b72145befa3c132a2e1cb09fdb3. after waiting 0 ms 2023-09-27 00:01:04,436 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695772864356.d5e72453cfbd0391a5f4d754242007a6. 2023-09-27 00:01:04,436 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695772864356.26750b72145befa3c132a2e1cb09fdb3. 2023-09-27 00:01:04,436 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695772864356.d5e72453cfbd0391a5f4d754242007a6. 2023-09-27 00:01:04,436 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695772864356.26750b72145befa3c132a2e1cb09fdb3. 2023-09-27 00:01:04,436 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for d5e72453cfbd0391a5f4d754242007a6: 2023-09-27 00:01:04,436 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 26750b72145befa3c132a2e1cb09fdb3: 2023-09-27 00:01:04,441 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-09-27 00:01:04,442 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695772864356.d5e72453cfbd0391a5f4d754242007a6.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695772864442"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695772864442"}]},"ts":"1695772864442"} 2023-09-27 00:01:04,442 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695772864356.26750b72145befa3c132a2e1cb09fdb3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695772864442"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695772864442"}]},"ts":"1695772864442"} 2023-09-27 00:01:04,460 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-27 00:01:04,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-27 00:01:04,516 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-27 00:01:04,517 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-27 00:01:04,518 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695772864517"}]},"ts":"1695772864517"} 2023-09-27 00:01:04,520 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-09-27 00:01:04,526 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-09-27 00:01:04,531 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 00:01:04,531 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 00:01:04,531 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 00:01:04,531 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 00:01:04,532 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=26750b72145befa3c132a2e1cb09fdb3, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d5e72453cfbd0391a5f4d754242007a6, ASSIGN}] 2023-09-27 00:01:04,537 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d5e72453cfbd0391a5f4d754242007a6, ASSIGN 2023-09-27 00:01:04,537 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=26750b72145befa3c132a2e1cb09fdb3, ASSIGN 2023-09-27 00:01:04,542 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=26750b72145befa3c132a2e1cb09fdb3, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,41703,1695772857103; forceNewPlan=false, retain=false 2023-09-27 00:01:04,542 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d5e72453cfbd0391a5f4d754242007a6, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,36739,1695772857140; forceNewPlan=false, retain=false 2023-09-27 00:01:04,611 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-09-27 00:01:04,612 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-09-27 00:01:04,613 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-09-27 00:01:04,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-27 00:01:04,692 INFO [jenkins-hbase9:33541] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-27 00:01:04,694 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=d5e72453cfbd0391a5f4d754242007a6, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:04,694 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=26750b72145befa3c132a2e1cb09fdb3, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:04,695 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695772864356.d5e72453cfbd0391a5f4d754242007a6.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695772864694"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695772864694"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695772864694"}]},"ts":"1695772864694"} 2023-09-27 00:01:04,695 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695772864356.26750b72145befa3c132a2e1cb09fdb3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695772864694"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695772864694"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695772864694"}]},"ts":"1695772864694"} 2023-09-27 00:01:04,697 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure d5e72453cfbd0391a5f4d754242007a6, server=jenkins-hbase9.apache.org,36739,1695772857140}] 2023-09-27 00:01:04,699 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 26750b72145befa3c132a2e1cb09fdb3, server=jenkins-hbase9.apache.org,41703,1695772857103}] 2023-09-27 00:01:04,851 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:04,852 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-27 00:01:04,853 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:37942, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-27 00:01:04,857 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1695772864356.26750b72145befa3c132a2e1cb09fdb3. 2023-09-27 00:01:04,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 26750b72145befa3c132a2e1cb09fdb3, NAME => 'testtb-testExportWithTargetName,,1695772864356.26750b72145befa3c132a2e1cb09fdb3.', STARTKEY => '', ENDKEY => '1'} 2023-09-27 00:01:04,858 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1695772864356.d5e72453cfbd0391a5f4d754242007a6. 2023-09-27 00:01:04,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1695772864356.26750b72145befa3c132a2e1cb09fdb3. service=AccessControlService 2023-09-27 00:01:04,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d5e72453cfbd0391a5f4d754242007a6, NAME => 'testtb-testExportWithTargetName,1,1695772864356.d5e72453cfbd0391a5f4d754242007a6.', STARTKEY => '1', ENDKEY => ''} 2023-09-27 00:01:04,858 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 00:01:04,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1695772864356.d5e72453cfbd0391a5f4d754242007a6. service=AccessControlService 2023-09-27 00:01:04,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 26750b72145befa3c132a2e1cb09fdb3 2023-09-27 00:01:04,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695772864356.26750b72145befa3c132a2e1cb09fdb3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 00:01:04,859 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 00:01:04,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 26750b72145befa3c132a2e1cb09fdb3 2023-09-27 00:01:04,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 26750b72145befa3c132a2e1cb09fdb3 2023-09-27 00:01:04,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName d5e72453cfbd0391a5f4d754242007a6 2023-09-27 00:01:04,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695772864356.d5e72453cfbd0391a5f4d754242007a6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 00:01:04,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for d5e72453cfbd0391a5f4d754242007a6 2023-09-27 00:01:04,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for d5e72453cfbd0391a5f4d754242007a6 2023-09-27 00:01:04,866 INFO [StoreOpener-26750b72145befa3c132a2e1cb09fdb3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 26750b72145befa3c132a2e1cb09fdb3 2023-09-27 00:01:04,866 INFO [StoreOpener-d5e72453cfbd0391a5f4d754242007a6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d5e72453cfbd0391a5f4d754242007a6 2023-09-27 00:01:04,868 DEBUG [StoreOpener-d5e72453cfbd0391a5f4d754242007a6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportWithTargetName/d5e72453cfbd0391a5f4d754242007a6/cf 2023-09-27 00:01:04,868 DEBUG [StoreOpener-d5e72453cfbd0391a5f4d754242007a6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportWithTargetName/d5e72453cfbd0391a5f4d754242007a6/cf 2023-09-27 00:01:04,868 DEBUG [StoreOpener-26750b72145befa3c132a2e1cb09fdb3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportWithTargetName/26750b72145befa3c132a2e1cb09fdb3/cf 2023-09-27 00:01:04,868 DEBUG [StoreOpener-26750b72145befa3c132a2e1cb09fdb3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportWithTargetName/26750b72145befa3c132a2e1cb09fdb3/cf 2023-09-27 00:01:04,872 INFO [StoreOpener-d5e72453cfbd0391a5f4d754242007a6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d5e72453cfbd0391a5f4d754242007a6 columnFamilyName cf 2023-09-27 00:01:04,872 INFO [StoreOpener-26750b72145befa3c132a2e1cb09fdb3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 26750b72145befa3c132a2e1cb09fdb3 columnFamilyName cf 2023-09-27 00:01:04,875 INFO [StoreOpener-26750b72145befa3c132a2e1cb09fdb3-1] regionserver.HStore(310): Store=26750b72145befa3c132a2e1cb09fdb3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 00:01:04,875 INFO [StoreOpener-d5e72453cfbd0391a5f4d754242007a6-1] regionserver.HStore(310): Store=d5e72453cfbd0391a5f4d754242007a6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 00:01:04,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportWithTargetName/d5e72453cfbd0391a5f4d754242007a6 2023-09-27 00:01:04,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportWithTargetName/26750b72145befa3c132a2e1cb09fdb3 2023-09-27 00:01:04,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportWithTargetName/d5e72453cfbd0391a5f4d754242007a6 2023-09-27 00:01:04,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportWithTargetName/26750b72145befa3c132a2e1cb09fdb3 2023-09-27 00:01:04,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 26750b72145befa3c132a2e1cb09fdb3 2023-09-27 00:01:04,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for d5e72453cfbd0391a5f4d754242007a6 2023-09-27 00:01:04,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportWithTargetName/26750b72145befa3c132a2e1cb09fdb3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 00:01:04,891 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 26750b72145befa3c132a2e1cb09fdb3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71291628, jitterRate=0.062328040599823}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 00:01:04,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 26750b72145befa3c132a2e1cb09fdb3: 2023-09-27 00:01:04,893 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1695772864356.26750b72145befa3c132a2e1cb09fdb3., pid=16, masterSystemTime=1695772864851 2023-09-27 00:01:04,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportWithTargetName/d5e72453cfbd0391a5f4d754242007a6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 00:01:04,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1695772864356.26750b72145befa3c132a2e1cb09fdb3. 2023-09-27 00:01:04,897 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1695772864356.26750b72145befa3c132a2e1cb09fdb3. 2023-09-27 00:01:04,897 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened d5e72453cfbd0391a5f4d754242007a6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62618544, jitterRate=-0.06691098213195801}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 00:01:04,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for d5e72453cfbd0391a5f4d754242007a6: 2023-09-27 00:01:04,898 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=26750b72145befa3c132a2e1cb09fdb3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:04,898 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1695772864356.26750b72145befa3c132a2e1cb09fdb3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695772864898"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695772864898"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695772864898"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695772864898"}]},"ts":"1695772864898"} 2023-09-27 00:01:04,899 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1695772864356.d5e72453cfbd0391a5f4d754242007a6., pid=15, masterSystemTime=1695772864851 2023-09-27 00:01:04,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1695772864356.d5e72453cfbd0391a5f4d754242007a6. 2023-09-27 00:01:04,905 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1695772864356.d5e72453cfbd0391a5f4d754242007a6. 2023-09-27 00:01:04,906 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=d5e72453cfbd0391a5f4d754242007a6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:04,907 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1695772864356.d5e72453cfbd0391a5f4d754242007a6.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695772864906"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695772864906"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695772864906"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695772864906"}]},"ts":"1695772864906"} 2023-09-27 00:01:04,909 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=13 2023-09-27 00:01:04,909 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 26750b72145befa3c132a2e1cb09fdb3, server=jenkins-hbase9.apache.org,41703,1695772857103 in 204 msec 2023-09-27 00:01:04,912 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=26750b72145befa3c132a2e1cb09fdb3, ASSIGN in 378 msec 2023-09-27 00:01:04,915 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-09-27 00:01:04,915 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure d5e72453cfbd0391a5f4d754242007a6, server=jenkins-hbase9.apache.org,36739,1695772857140 in 212 msec 2023-09-27 00:01:04,918 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=12 2023-09-27 00:01:04,918 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d5e72453cfbd0391a5f4d754242007a6, ASSIGN in 384 msec 2023-09-27 00:01:04,919 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-27 00:01:04,920 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695772864919"}]},"ts":"1695772864919"} 2023-09-27 00:01:04,922 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-09-27 00:01:04,924 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-09-27 00:01:04,929 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-09-27 00:01:04,946 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41869] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-27 00:01:04,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-27 00:01:04,979 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-27 00:01:04,980 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-27 00:01:04,979 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-27 00:01:04,980 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-27 00:01:04,980 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 00:01:04,987 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-27 00:01:04,987 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-27 00:01:04,987 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-27 00:01:04,987 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-27 00:01:04,988 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-27 00:01:04,991 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 631 msec 2023-09-27 00:01:05,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-27 00:01:05,476 INFO [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-09-27 00:01:05,481 DEBUG [Listener at jenkins-hbase9.apache.org/45033] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-27 00:01:05,481 DEBUG [Listener at jenkins-hbase9.apache.org/45033] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695772864356.26750b72145befa3c132a2e1cb09fdb3. 2023-09-27 00:01:05,484 INFO [Listener at jenkins-hbase9.apache.org/45033] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 00:01:05,507 DEBUG [hconnection-0x3ca857b3-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 00:01:05,510 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35816, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 00:01:05,513 DEBUG [hconnection-0x3ca857b3-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 00:01:05,517 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:37954, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 00:01:05,529 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-27 00:01:05,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695772865529 (current time:1695772865529). 2023-09-27 00:01:05,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 00:01:05,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(139): Connect 0x1c44414c to 127.0.0.1:57983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 00:01:05,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@816e4cf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 00:01:05,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 00:01:05,540 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:60670, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 00:01:05,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c44414c to 127.0.0.1:57983 2023-09-27 00:01:05,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 00:01:05,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(139): Connect 0x1da41d55 to 127.0.0.1:57983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 00:01:05,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d3af36f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 00:01:05,550 DEBUG [hconnection-0x2fee091c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 00:01:05,553 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:60674, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 00:01:05,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1da41d55 to 127.0.0.1:57983 2023-09-27 00:01:05,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 00:01:05,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-27 00:01:05,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 00:01:05,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-27 00:01:05,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-27 00:01:05,607 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-27 00:01:05,608 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695773465608 2023-09-27 00:01:05,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-27 00:01:05,609 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-27 00:01:05,613 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-27 00:01:05,613 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-27 00:01:05,615 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 17 msec 2023-09-27 00:01:05,615 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-27 00:01:05,615 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 00:01:05,616 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 00:01:05,616 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695773465616 2023-09-27 00:01:05,644 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,644 INFO [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-09-27 00:01:05,644 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:01:05,645 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-09-27 00:01:05,645 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-27 00:01:05,646 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,646 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,658 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:01:05,658 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:05,658 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:01:05,658 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:01:05,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:01:05,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:01:05,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:01:05,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:01:05,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:01:05,658 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:05,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:01:05,658 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:05,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,659 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:05,659 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 00:01:05,659 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,659 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,659 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-27 00:01:05,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-27 00:01:05,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-27 00:01:05,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,661 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-27 00:01:05,661 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-27 00:01:05,661 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-27 00:01:05,666 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,666 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,667 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,667 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-27 00:01:05,667 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-27 00:01:05,667 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-27 00:01:05,667 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:01:05,667 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:01:05,668 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-27 00:01:05,668 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-27 00:01:05,668 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-27 00:01:05,667 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:01:05,668 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,36739,1695772857140' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-27 00:01:05,669 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-27 00:01:05,668 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-27 00:01:05,669 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41703,1695772857103' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-27 00:01:05,669 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-27 00:01:05,669 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41869,1695772857056' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-27 00:01:05,671 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:05,671 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,672 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:05,672 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:05,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:01:05,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:01:05,673 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,673 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:01:05,673 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,673 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 00:01:05,673 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 00:01:05,673 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,673 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 00:01:05,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:01:05,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:05,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:05,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:05,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:01:05,675 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,36739,1695772857140' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-27 00:01:05,675 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@248f248b[Count = 1] remaining members to acquire global barrier 2023-09-27 00:01:05,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:05,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:01:05,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:01:05,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:01:05,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:01:05,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:05,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:05,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:05,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:01:05,678 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,41703,1695772857103' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-27 00:01:05,678 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@248f248b[Count = 0] remaining members to acquire global barrier 2023-09-27 00:01:05,678 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-27 00:01:05,678 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,680 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,680 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,680 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,681 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:05,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,681 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-27 00:01:05,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,681 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-27 00:01:05,681 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-27 00:01:05,681 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-27 00:01:05,681 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:05,681 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,41869,1695772857056' in zk 2023-09-27 00:01:05,681 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 00:01:05,682 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 00:01:05,682 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 00:01:05,682 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695772864356.d5e72453cfbd0391a5f4d754242007a6. 2023-09-27 00:01:05,682 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695772864356.d5e72453cfbd0391a5f4d754242007a6. started... 2023-09-27 00:01:05,685 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 00:01:05,685 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 00:01:05,685 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695772864356.26750b72145befa3c132a2e1cb09fdb3. 2023-09-27 00:01:05,685 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695772864356.26750b72145befa3c132a2e1cb09fdb3. started... 2023-09-27 00:01:05,685 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-27 00:01:05,685 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:01:05,685 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-27 00:01:05,687 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 26750b72145befa3c132a2e1cb09fdb3: 2023-09-27 00:01:05,687 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d5e72453cfbd0391a5f4d754242007a6: 2023-09-27 00:01:05,688 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695772864356.26750b72145befa3c132a2e1cb09fdb3.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,688 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695772864356.d5e72453cfbd0391a5f4d754242007a6.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,694 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 00:01:05,694 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 00:01:05,697 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 00:01:05,697 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 00:01:05,716 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 00:01:05,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-27 00:01:05,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-27 00:01:05,722 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 00:01:05,722 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695772864356.d5e72453cfbd0391a5f4d754242007a6. completed. 2023-09-27 00:01:05,722 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695772864356.d5e72453cfbd0391a5f4d754242007a6. 2023-09-27 00:01:05,722 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695772864356.26750b72145befa3c132a2e1cb09fdb3. completed. 2023-09-27 00:01:05,722 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695772864356.26750b72145befa3c132a2e1cb09fdb3. 2023-09-27 00:01:05,723 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 00:01:05,723 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 00:01:05,723 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 00:01:05,723 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 00:01:05,723 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:05,723 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:05,723 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-27 00:01:05,723 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,41703,1695772857103' in zk 2023-09-27 00:01:05,723 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-27 00:01:05,723 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,36739,1695772857140' in zk 2023-09-27 00:01:05,725 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-27 00:01:05,725 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:01:05,725 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:05,725 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-27 00:01:05,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:05,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:01:05,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:01:05,726 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:05,726 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-27 00:01:05,727 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:01:05,727 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-27 00:01:05,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:01:05,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:01:05,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:05,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:05,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:05,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:01:05,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:05,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:05,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:05,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,36739,1695772857140': 2023-09-27 00:01:05,733 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,36739,1695772857140' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-27 00:01:05,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:05,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:01:05,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:01:05,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:01:05,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:01:05,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:05,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:05,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:05,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:01:05,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:05,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:05,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:05,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,41703,1695772857103': 2023-09-27 00:01:05,739 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,41703,1695772857103' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-27 00:01:05,739 INFO [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-09-27 00:01:05,739 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 00:01:05,739 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 00:01:05,739 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,739 INFO [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 00:01:05,742 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,742 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,742 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:01:05,742 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,742 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,742 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:01:05,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:01:05,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:01:05,743 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:01:05,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:01:05,743 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:05,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:01:05,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:01:05,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:01:05,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:01:05,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:01:05,744 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:05,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:01:05,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,745 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:05,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:01:05,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:05,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:05,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:05,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:01:05,750 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:05,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,750 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:05,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:05,750 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:05,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:05,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:05,766 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:01:05,766 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:05,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:01:05,766 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:01:05,766 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:01:05,766 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:01:05,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:01:05,766 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,766 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:01:05,766 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-27 00:01:05,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:01:05,766 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,767 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,766 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:01:05,767 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 00:01:05,767 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:05,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:01:05,767 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:05,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:01:05,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:01:05,766 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:01:05,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:01:05,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:01:05,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:01:05,768 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:01:05,768 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:05,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:01:05,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:01:05,768 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,768 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:05,768 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:05,768 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,768 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,768 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-27 00:01:05,793 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,795 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,843 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,844 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-27 00:01:05,844 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,845 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:05,845 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695772865609Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695772865793 (+184 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1695772865793Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1695772865793Writing data manifest for emptySnaptb0-testExportWithTargetName at 1695772865804 (+11 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1695772865832 (+28 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695772865844 (+12 ms) 2023-09-27 00:01:05,847 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-27 00:01:05,849 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 237 msec 2023-09-27 00:01:05,922 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 00:01:05,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-27 00:01:05,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 00:01:05,941 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41703] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1695772864356.26750b72145befa3c132a2e1cb09fdb3. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 00:01:05,944 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36739] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1695772864356.d5e72453cfbd0391a5f4d754242007a6. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 00:01:05,949 DEBUG [Listener at jenkins-hbase9.apache.org/45033] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-27 00:01:05,949 DEBUG [Listener at jenkins-hbase9.apache.org/45033] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695772864356.26750b72145befa3c132a2e1cb09fdb3. 2023-09-27 00:01:05,949 INFO [Listener at jenkins-hbase9.apache.org/45033] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 00:01:05,964 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-27 00:01:05,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695772865964 (current time:1695772865964). 2023-09-27 00:01:05,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 00:01:05,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(139): Connect 0x0dac11c1 to 127.0.0.1:57983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 00:01:05,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7cd0a586, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 00:01:05,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 00:01:05,975 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:60688, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 00:01:05,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0dac11c1 to 127.0.0.1:57983 2023-09-27 00:01:05,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 00:01:05,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(139): Connect 0x77f17fb3 to 127.0.0.1:57983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 00:01:05,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1abe4a95, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 00:01:05,984 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 00:01:05,984 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-09-27 00:01:05,985 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 00:01:05,985 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-09-27 00:01:05,985 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-27 00:01:05,985 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-09-27 00:01:05,985 DEBUG [hconnection-0x633b20d1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 00:01:05,985 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 00:01:05,985 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-09-27 00:01:05,985 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-27 00:01:05,985 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-09-27 00:01:05,987 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:60692, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 00:01:05,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x77f17fb3 to 127.0.0.1:57983 2023-09-27 00:01:05,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 00:01:05,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-27 00:01:05,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 00:01:05,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-27 00:01:05,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-27 00:01:06,000 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-27 00:01:06,001 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695773466001 2023-09-27 00:01:06,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-27 00:01:06,001 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-27 00:01:06,002 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 00:01:06,003 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 00:01:06,004 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-27 00:01:06,004 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-27 00:01:06,005 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-09-27 00:01:06,006 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-27 00:01:06,007 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695773466007 2023-09-27 00:01:06,026 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-09-27 00:01:06,026 INFO [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-09-27 00:01:06,026 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:01:06,027 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-09-27 00:01:06,027 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-27 00:01:06,027 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,027 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,029 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:01:06,029 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:06,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:01:06,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:01:06,029 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:01:06,029 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:01:06,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:01:06,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:01:06,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:01:06,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:01:06,029 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:06,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,029 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:06,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,030 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,030 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:06,030 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 00:01:06,030 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-27 00:01:06,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,030 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,030 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-27 00:01:06,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-27 00:01:06,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,031 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-27 00:01:06,031 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-27 00:01:06,033 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-27 00:01:06,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-27 00:01:06,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,034 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-27 00:01:06,034 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:01:06,034 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-27 00:01:06,034 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-27 00:01:06,034 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-27 00:01:06,035 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-27 00:01:06,035 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:01:06,035 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,36739,1695772857140' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-27 00:01:06,035 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-27 00:01:06,035 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-27 00:01:06,036 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-27 00:01:06,036 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-27 00:01:06,036 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41869,1695772857056' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-27 00:01:06,036 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:01:06,036 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-27 00:01:06,036 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-27 00:01:06,037 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41703,1695772857103' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-27 00:01:06,039 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:06,039 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:06,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:01:06,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:01:06,040 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,041 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:06,041 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,041 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,041 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 00:01:06,041 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,042 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 00:01:06,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:01:06,042 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,042 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 00:01:06,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:01:06,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-27 00:01:06,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:06,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:06,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:06,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:01:06,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,36739,1695772857140' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-27 00:01:06,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7f245bd1[Count = 1] remaining members to acquire global barrier 2023-09-27 00:01:06,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:06,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:01:06,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:01:06,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:01:06,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:01:06,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-27 00:01:06,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:06,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:06,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:06,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:01:06,047 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,41703,1695772857103' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-27 00:01:06,047 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7f245bd1[Count = 0] remaining members to acquire global barrier 2023-09-27 00:01:06,047 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-27 00:01:06,047 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,053 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,053 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,053 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,054 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-27 00:01:06,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,054 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:06,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,054 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 00:01:06,054 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-27 00:01:06,054 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-27 00:01:06,054 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 00:01:06,054 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 00:01:06,054 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:06,054 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695772864356.26750b72145befa3c132a2e1cb09fdb3. 2023-09-27 00:01:06,054 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 00:01:06,054 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695772864356.26750b72145befa3c132a2e1cb09fdb3. started... 2023-09-27 00:01:06,054 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 00:01:06,054 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695772864356.d5e72453cfbd0391a5f4d754242007a6. 2023-09-27 00:01:06,054 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-27 00:01:06,055 INFO [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 26750b72145befa3c132a2e1cb09fdb3 1/1 column families, dataSize=65 B heapSize=400 B 2023-09-27 00:01:06,055 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,41869,1695772857056' in zk 2023-09-27 00:01:06,055 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695772864356.d5e72453cfbd0391a5f4d754242007a6. started... 2023-09-27 00:01:06,055 INFO [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d5e72453cfbd0391a5f4d754242007a6 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-09-27 00:01:06,059 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-27 00:01:06,059 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:01:06,059 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-27 00:01:06,103 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 00:01:06,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-27 00:01:06,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-27 00:01:06,105 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 00:01:06,185 INFO [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309279a76699b24db4a73b17f53f96e87f4b1 to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309279a76699b24db4a73b17f53f96e87f4b1 2023-09-27 00:01:06,185 INFO [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230927b9958cc3b36447be98e367ccc08c7320 to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230927b9958cc3b36447be98e367ccc08c7320 2023-09-27 00:01:06,220 INFO [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=65, hasBloomFilter=true, into tmp file hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportWithTargetName/26750b72145befa3c132a2e1cb09fdb3/.tmp/cf/2e3442b9ce764871b97ab8e11cd73990 2023-09-27 00:01:06,220 INFO [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.2 K, hasBloomFilter=true, into tmp file hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportWithTargetName/d5e72453cfbd0391a5f4d754242007a6/.tmp/cf/348f7179533c471ab3406a455e5d3b2a 2023-09-27 00:01:06,231 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportWithTargetName/d5e72453cfbd0391a5f4d754242007a6/.tmp/cf/348f7179533c471ab3406a455e5d3b2a as hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportWithTargetName/d5e72453cfbd0391a5f4d754242007a6/cf/348f7179533c471ab3406a455e5d3b2a 2023-09-27 00:01:06,231 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportWithTargetName/26750b72145befa3c132a2e1cb09fdb3/.tmp/cf/2e3442b9ce764871b97ab8e11cd73990 as hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportWithTargetName/26750b72145befa3c132a2e1cb09fdb3/cf/2e3442b9ce764871b97ab8e11cd73990 2023-09-27 00:01:06,239 INFO [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportWithTargetName/26750b72145befa3c132a2e1cb09fdb3/cf/2e3442b9ce764871b97ab8e11cd73990, entries=1, sequenceid=6, filesize=5.1 K 2023-09-27 00:01:06,239 INFO [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportWithTargetName/d5e72453cfbd0391a5f4d754242007a6/cf/348f7179533c471ab3406a455e5d3b2a, entries=49, sequenceid=6, filesize=13.1 K 2023-09-27 00:01:06,244 INFO [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for 26750b72145befa3c132a2e1cb09fdb3 in 189ms, sequenceid=6, compaction requested=false 2023-09-27 00:01:06,244 INFO [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for d5e72453cfbd0391a5f4d754242007a6 in 189ms, sequenceid=6, compaction requested=false 2023-09-27 00:01:06,244 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-27 00:01:06,244 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-27 00:01:06,246 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 26750b72145befa3c132a2e1cb09fdb3: 2023-09-27 00:01:06,246 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d5e72453cfbd0391a5f4d754242007a6: 2023-09-27 00:01:06,247 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695772864356.26750b72145befa3c132a2e1cb09fdb3.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-27 00:01:06,247 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695772864356.d5e72453cfbd0391a5f4d754242007a6.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-27 00:01:06,247 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 00:01:06,247 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 00:01:06,247 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportWithTargetName/26750b72145befa3c132a2e1cb09fdb3/cf/2e3442b9ce764871b97ab8e11cd73990] hfiles 2023-09-27 00:01:06,247 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportWithTargetName/d5e72453cfbd0391a5f4d754242007a6/cf/348f7179533c471ab3406a455e5d3b2a] hfiles 2023-09-27 00:01:06,247 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportWithTargetName/26750b72145befa3c132a2e1cb09fdb3/cf/2e3442b9ce764871b97ab8e11cd73990 for snapshot=snaptb0-testExportWithTargetName 2023-09-27 00:01:06,247 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportWithTargetName/d5e72453cfbd0391a5f4d754242007a6/cf/348f7179533c471ab3406a455e5d3b2a for snapshot=snaptb0-testExportWithTargetName 2023-09-27 00:01:06,269 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695772864356.26750b72145befa3c132a2e1cb09fdb3. completed. 2023-09-27 00:01:06,269 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695772864356.d5e72453cfbd0391a5f4d754242007a6. completed. 2023-09-27 00:01:06,269 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695772864356.d5e72453cfbd0391a5f4d754242007a6. 2023-09-27 00:01:06,269 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695772864356.26750b72145befa3c132a2e1cb09fdb3. 2023-09-27 00:01:06,270 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 00:01:06,270 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 00:01:06,270 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 00:01:06,270 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:06,270 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 00:01:06,270 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-27 00:01:06,270 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:06,270 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,41703,1695772857103' in zk 2023-09-27 00:01:06,270 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-27 00:01:06,270 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,36739,1695772857140' in zk 2023-09-27 00:01:06,274 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:06,274 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-27 00:01:06,274 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-27 00:01:06,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:06,274 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:01:06,274 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:06,274 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-27 00:01:06,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:01:06,274 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:01:06,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:01:06,275 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-27 00:01:06,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:01:06,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:01:06,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-27 00:01:06,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:06,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:06,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:06,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:01:06,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-27 00:01:06,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:06,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:06,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:06,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,41703,1695772857103': 2023-09-27 00:01:06,280 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,41703,1695772857103' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-27 00:01:06,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:06,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:01:06,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:01:06,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:01:06,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:01:06,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-27 00:01:06,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:06,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:06,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:06,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:01:06,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-27 00:01:06,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:06,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:06,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:06,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,36739,1695772857140': 2023-09-27 00:01:06,285 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,36739,1695772857140' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-27 00:01:06,285 INFO [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-09-27 00:01:06,285 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 00:01:06,285 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 00:01:06,285 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-09-27 00:01:06,285 INFO [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 00:01:06,287 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,287 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,287 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,287 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:01:06,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:01:06,287 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:01:06,287 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:01:06,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,287 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:01:06,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:01:06,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:01:06,288 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:06,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:01:06,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:01:06,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:01:06,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-27 00:01:06,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:01:06,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:01:06,288 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:06,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:01:06,289 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:06,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-27 00:01:06,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:06,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:06,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:06,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:01:06,292 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:06,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-27 00:01:06,293 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:06,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:06,293 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:06,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:06,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:06,304 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:01:06,304 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:06,305 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,305 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:01:06,305 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 00:01:06,304 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-09-27 00:01:06,306 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:01:06,306 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:01:06,305 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:01:06,305 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:06,306 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:06,306 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,306 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:06,306 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,306 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:06,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:01:06,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:01:06,306 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-27 00:01:06,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:01:06,306 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:01:06,306 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-27 00:01:06,306 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:01:06,306 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 00:01:06,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:01:06,306 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:06,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:01:06,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-27 00:01:06,307 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-27 00:01:06,307 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:01:06,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:01:06,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:01:06,308 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-27 00:01:06,308 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309279a76699b24db4a73b17f53f96e87f4b1, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230927b9958cc3b36447be98e367ccc08c7320] mob files 2023-09-27 00:01:06,308 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309279a76699b24db4a73b17f53f96e87f4b1 2023-09-27 00:01:06,308 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230927b9958cc3b36447be98e367ccc08c7320 2023-09-27 00:01:06,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:01:06,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:01:06,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:01:06,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:01:06,326 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-09-27 00:01:06,327 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,360 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,361 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-27 00:01:06,362 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,362 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-27 00:01:06,362 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695772866001Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695772866326 (+325 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1695772866326Loading Region manifests for snaptb0-testExportWithTargetName at 1695772866326Writing data manifest for snaptb0-testExportWithTargetName at 1695772866331 (+5 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1695772866349 (+18 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695772866361 (+12 ms) 2023-09-27 00:01:06,364 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-27 00:01:06,366 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 362 msec 2023-09-27 00:01:06,608 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 00:01:06,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-27 00:01:06,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 00:01:06,612 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772866612 2023-09-27 00:01:06,612 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40313, tgtDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772866612, rawTgtDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772866612, srcFsUri=hdfs://localhost:40313, srcDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8 2023-09-27 00:01:06,655 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40313, inputRoot=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8 2023-09-27 00:01:06,655 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2103457624_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772866612, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772866612/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-27 00:01:06,655 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40313, inputRoot=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8, snapshotDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-09-27 00:01:06,674 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772866612/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-27 00:01:06,730 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-27 00:01:06,731 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-27 00:01:06,731 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-27 00:01:06,732 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-27 00:01:07,612 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/hadoop-8917046116446064238.jar 2023-09-27 00:01:07,613 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-27 00:01:07,613 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-27 00:01:07,680 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/hadoop-858811124134619338.jar 2023-09-27 00:01:07,680 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-27 00:01:07,681 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-27 00:01:07,682 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-27 00:01:07,682 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-27 00:01:07,683 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-27 00:01:07,683 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-27 00:01:07,683 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-27 00:01:07,684 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-27 00:01:07,685 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-27 00:01:07,685 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-27 00:01:07,686 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-27 00:01:07,686 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-27 00:01:07,687 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-27 00:01:07,687 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-27 00:01:07,687 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-27 00:01:07,688 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-27 00:01:07,692 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 00:01:07,692 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 00:01:07,692 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 00:01:07,693 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 00:01:07,693 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 00:01:07,694 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 00:01:07,694 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 00:01:08,500 WARN [Listener at jenkins-hbase9.apache.org/45033] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-27 00:01:08,507 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-09-27 00:01:08,517 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-27 00:01:09,003 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 00:01:09,005 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 00:01:09,229 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695772863328_0001_000001 (auth:SIMPLE) 2023-09-27 00:01:10,366 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-27 00:01:13,455 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695772863328_0001_000001 (auth:SIMPLE) 2023-09-27 00:01:15,695 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695772863328_0001_000001 (auth:SIMPLE) 2023-09-27 00:01:18,416 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695772863328_0001_000001 (auth:SIMPLE) 2023-09-27 00:01:20,371 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-27 00:01:20,374 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-27 00:01:20,384 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-09-27 00:01:20,384 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-27 00:01:20,385 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-27 00:01:20,385 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-728144799_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-27 00:01:20,386 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(367): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-09-27 00:01:20,386 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(367): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-09-27 00:01:20,386 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-728144799_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772866612/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772866612/.hbase-snapshot/testExportWithTargetName 2023-09-27 00:01:20,386 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(367): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772866612/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-09-27 00:01:20,386 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(367): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772866612/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-09-27 00:01:20,398 INFO [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-09-27 00:01:20,403 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportWithTargetName 2023-09-27 00:01:20,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-09-27 00:01:20,414 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695772880414"}]},"ts":"1695772880414"} 2023-09-27 00:01:20,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-27 00:01:20,416 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-09-27 00:01:20,453 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-09-27 00:01:20,455 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=26750b72145befa3c132a2e1cb09fdb3, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d5e72453cfbd0391a5f4d754242007a6, UNASSIGN}] 2023-09-27 00:01:20,458 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=26750b72145befa3c132a2e1cb09fdb3, UNASSIGN 2023-09-27 00:01:20,458 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d5e72453cfbd0391a5f4d754242007a6, UNASSIGN 2023-09-27 00:01:20,459 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=26750b72145befa3c132a2e1cb09fdb3, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:20,459 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695772864356.26750b72145befa3c132a2e1cb09fdb3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695772880459"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695772880459"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695772880459"}]},"ts":"1695772880459"} 2023-09-27 00:01:20,459 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=d5e72453cfbd0391a5f4d754242007a6, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:20,460 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695772864356.d5e72453cfbd0391a5f4d754242007a6.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695772880459"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695772880459"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695772880459"}]},"ts":"1695772880459"} 2023-09-27 00:01:20,465 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 26750b72145befa3c132a2e1cb09fdb3, server=jenkins-hbase9.apache.org,41703,1695772857103}] 2023-09-27 00:01:20,465 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure d5e72453cfbd0391a5f4d754242007a6, server=jenkins-hbase9.apache.org,36739,1695772857140}] 2023-09-27 00:01:20,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-27 00:01:20,628 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close d5e72453cfbd0391a5f4d754242007a6 2023-09-27 00:01:20,628 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 26750b72145befa3c132a2e1cb09fdb3 2023-09-27 00:01:20,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing d5e72453cfbd0391a5f4d754242007a6, disabling compactions & flushes 2023-09-27 00:01:20,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 26750b72145befa3c132a2e1cb09fdb3, disabling compactions & flushes 2023-09-27 00:01:20,628 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695772864356.d5e72453cfbd0391a5f4d754242007a6. 2023-09-27 00:01:20,628 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695772864356.26750b72145befa3c132a2e1cb09fdb3. 2023-09-27 00:01:20,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695772864356.d5e72453cfbd0391a5f4d754242007a6. 2023-09-27 00:01:20,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695772864356.26750b72145befa3c132a2e1cb09fdb3. 2023-09-27 00:01:20,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695772864356.d5e72453cfbd0391a5f4d754242007a6. after waiting 0 ms 2023-09-27 00:01:20,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695772864356.26750b72145befa3c132a2e1cb09fdb3. after waiting 0 ms 2023-09-27 00:01:20,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695772864356.26750b72145befa3c132a2e1cb09fdb3. 2023-09-27 00:01:20,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695772864356.d5e72453cfbd0391a5f4d754242007a6. 2023-09-27 00:01:20,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportWithTargetName/26750b72145befa3c132a2e1cb09fdb3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 00:01:20,642 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportWithTargetName/d5e72453cfbd0391a5f4d754242007a6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 00:01:20,642 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 00:01:20,642 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 00:01:20,643 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695772864356.26750b72145befa3c132a2e1cb09fdb3. 2023-09-27 00:01:20,643 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695772864356.d5e72453cfbd0391a5f4d754242007a6. 2023-09-27 00:01:20,643 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 26750b72145befa3c132a2e1cb09fdb3: 2023-09-27 00:01:20,643 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for d5e72453cfbd0391a5f4d754242007a6: 2023-09-27 00:01:20,646 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 26750b72145befa3c132a2e1cb09fdb3 2023-09-27 00:01:20,647 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=26750b72145befa3c132a2e1cb09fdb3, regionState=CLOSED 2023-09-27 00:01:20,647 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695772864356.26750b72145befa3c132a2e1cb09fdb3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695772880646"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695772880646"}]},"ts":"1695772880646"} 2023-09-27 00:01:20,647 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed d5e72453cfbd0391a5f4d754242007a6 2023-09-27 00:01:20,648 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=d5e72453cfbd0391a5f4d754242007a6, regionState=CLOSED 2023-09-27 00:01:20,648 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695772864356.d5e72453cfbd0391a5f4d754242007a6.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695772880647"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695772880647"}]},"ts":"1695772880647"} 2023-09-27 00:01:20,651 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=22 2023-09-27 00:01:20,651 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 26750b72145befa3c132a2e1cb09fdb3, server=jenkins-hbase9.apache.org,41703,1695772857103 in 185 msec 2023-09-27 00:01:20,652 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=23 2023-09-27 00:01:20,652 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure d5e72453cfbd0391a5f4d754242007a6, server=jenkins-hbase9.apache.org,36739,1695772857140 in 185 msec 2023-09-27 00:01:20,655 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=26750b72145befa3c132a2e1cb09fdb3, UNASSIGN in 196 msec 2023-09-27 00:01:20,656 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=23, resume processing ppid=21 2023-09-27 00:01:20,656 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d5e72453cfbd0391a5f4d754242007a6, UNASSIGN in 197 msec 2023-09-27 00:01:20,657 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695772880657"}]},"ts":"1695772880657"} 2023-09-27 00:01:20,659 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-09-27 00:01:20,661 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-09-27 00:01:20,664 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 257 msec 2023-09-27 00:01:20,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-27 00:01:20,718 INFO [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-09-27 00:01:20,723 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportWithTargetName 2023-09-27 00:01:20,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-27 00:01:20,733 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-27 00:01:20,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-09-27 00:01:20,735 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-27 00:01:20,738 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41869] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-09-27 00:01:20,741 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-27 00:01:20,741 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-27 00:01:20,741 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-27 00:01:20,741 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-27 00:01:20,741 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportWithTargetName/26750b72145befa3c132a2e1cb09fdb3 2023-09-27 00:01:20,741 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportWithTargetName/d5e72453cfbd0391a5f4d754242007a6 2023-09-27 00:01:20,741 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-27 00:01:20,742 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-27 00:01:20,742 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-27 00:01:20,742 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-27 00:01:20,744 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-27 00:01:20,744 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:01:20,744 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-27 00:01:20,744 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-27 00:01:20,744 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:01:20,744 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-27 00:01:20,744 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:01:20,744 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:01:20,745 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportWithTargetName/26750b72145befa3c132a2e1cb09fdb3/cf, FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportWithTargetName/26750b72145befa3c132a2e1cb09fdb3/recovered.edits] 2023-09-27 00:01:20,745 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportWithTargetName/d5e72453cfbd0391a5f4d754242007a6/cf, FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportWithTargetName/d5e72453cfbd0391a5f4d754242007a6/recovered.edits] 2023-09-27 00:01:20,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-27 00:01:20,753 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportWithTargetName/d5e72453cfbd0391a5f4d754242007a6/cf/348f7179533c471ab3406a455e5d3b2a to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/archive/data/default/testtb-testExportWithTargetName/d5e72453cfbd0391a5f4d754242007a6/cf/348f7179533c471ab3406a455e5d3b2a 2023-09-27 00:01:20,753 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportWithTargetName/26750b72145befa3c132a2e1cb09fdb3/cf/2e3442b9ce764871b97ab8e11cd73990 to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/archive/data/default/testtb-testExportWithTargetName/26750b72145befa3c132a2e1cb09fdb3/cf/2e3442b9ce764871b97ab8e11cd73990 2023-09-27 00:01:20,758 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportWithTargetName/d5e72453cfbd0391a5f4d754242007a6/recovered.edits/9.seqid to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/archive/data/default/testtb-testExportWithTargetName/d5e72453cfbd0391a5f4d754242007a6/recovered.edits/9.seqid 2023-09-27 00:01:20,758 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportWithTargetName/26750b72145befa3c132a2e1cb09fdb3/recovered.edits/9.seqid to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/archive/data/default/testtb-testExportWithTargetName/26750b72145befa3c132a2e1cb09fdb3/recovered.edits/9.seqid 2023-09-27 00:01:20,759 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportWithTargetName/d5e72453cfbd0391a5f4d754242007a6 2023-09-27 00:01:20,759 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportWithTargetName/26750b72145befa3c132a2e1cb09fdb3 2023-09-27 00:01:20,759 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-27 00:01:20,759 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-27 00:01:20,760 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-09-27 00:01:20,765 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309279a76699b24db4a73b17f53f96e87f4b1 to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309279a76699b24db4a73b17f53f96e87f4b1 2023-09-27 00:01:20,767 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230927b9958cc3b36447be98e367ccc08c7320 to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230927b9958cc3b36447be98e367ccc08c7320 2023-09-27 00:01:20,767 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-27 00:01:20,770 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-27 00:01:20,799 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-09-27 00:01:20,802 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-09-27 00:01:20,804 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-27 00:01:20,804 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-09-27 00:01:20,804 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1695772864356.26750b72145befa3c132a2e1cb09fdb3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695772880804"}]},"ts":"9223372036854775807"} 2023-09-27 00:01:20,804 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1695772864356.d5e72453cfbd0391a5f4d754242007a6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695772880804"}]},"ts":"9223372036854775807"} 2023-09-27 00:01:20,807 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-27 00:01:20,807 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 26750b72145befa3c132a2e1cb09fdb3, NAME => 'testtb-testExportWithTargetName,,1695772864356.26750b72145befa3c132a2e1cb09fdb3.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => d5e72453cfbd0391a5f4d754242007a6, NAME => 'testtb-testExportWithTargetName,1,1695772864356.d5e72453cfbd0391a5f4d754242007a6.', STARTKEY => '1', ENDKEY => ''}] 2023-09-27 00:01:20,807 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-09-27 00:01:20,807 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695772880807"}]},"ts":"9223372036854775807"} 2023-09-27 00:01:20,809 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-09-27 00:01:20,811 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-27 00:01:20,813 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 87 msec 2023-09-27 00:01:20,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-27 00:01:20,851 INFO [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-09-27 00:01:20,869 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportWithTargetName" 2023-09-27 00:01:20,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-09-27 00:01:20,874 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportWithTargetName" 2023-09-27 00:01:20,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-09-27 00:01:20,905 INFO [Listener at jenkins-hbase9.apache.org/45033] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=754 (was 708) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1988502388) connection to jenkins-hbase9.apache.org/172.31.2.10:35363 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/cluster_7e1535aa-dfbb-2328-367c-8d044f898abe/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-728144799_17 at /127.0.0.1:40224 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/cluster_7e1535aa-dfbb-2328-367c-8d044f898abe/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1988502388) connection to jenkins-hbase9.apache.org/172.31.2.10:44231 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/cluster_7e1535aa-dfbb-2328-367c-8d044f898abe/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'JobHistoryServer' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1988502388) connection to jenkins-hbase9.apache.org/172.31.2.10:42911 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-330063693_1 at /127.0.0.1:40084 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/cluster_7e1535aa-dfbb-2328-367c-8d044f898abe/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/cluster_7e1535aa-dfbb-2328-367c-8d044f898abe/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-728144799_17 at /127.0.0.1:40110 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/cluster_7e1535aa-dfbb-2328-367c-8d044f898abe/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-728144799_17 at /127.0.0.1:40340 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x49a14021-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x49a14021-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x49a14021-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1281 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x49a14021-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=928 (was 900) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=246 (was 138) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 165) - ProcessCount LEAK? -, AvailableMemoryMB=6843 (was 7666) 2023-09-27 00:01:20,905 WARN [Listener at jenkins-hbase9.apache.org/45033] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-09-27 00:01:20,923 INFO [Listener at jenkins-hbase9.apache.org/45033] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=754, OpenFileDescriptor=928, MaxFileDescriptor=60000, SystemLoadAverage=246, ProcessCount=168, AvailableMemoryMB=6842 2023-09-27 00:01:20,923 WARN [Listener at jenkins-hbase9.apache.org/45033] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-09-27 00:01:20,925 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-27 00:01:20,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-09-27 00:01:20,930 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-27 00:01:20,931 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-09-27 00:01:20,932 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-27 00:01:20,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-27 00:01:20,934 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemState/6d6cb2271a4a80ef4703953d2e166442 2023-09-27 00:01:20,936 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemState/6d6cb2271a4a80ef4703953d2e166442 empty. 2023-09-27 00:01:20,936 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemState/f038c684f3727a946ef1f9d1672181b0 2023-09-27 00:01:20,937 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemState/6d6cb2271a4a80ef4703953d2e166442 2023-09-27 00:01:20,937 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemState/f038c684f3727a946ef1f9d1672181b0 empty. 2023-09-27 00:01:20,937 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemState/f038c684f3727a946ef1f9d1672181b0 2023-09-27 00:01:20,937 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-27 00:01:20,949 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-27 00:01:20,950 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6d6cb2271a4a80ef4703953d2e166442, NAME => 'testtb-testExportFileSystemState,,1695772880925.6d6cb2271a4a80ef4703953d2e166442.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp 2023-09-27 00:01:20,950 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => f038c684f3727a946ef1f9d1672181b0, NAME => 'testtb-testExportFileSystemState,1,1695772880925.f038c684f3727a946ef1f9d1672181b0.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp 2023-09-27 00:01:20,966 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695772880925.6d6cb2271a4a80ef4703953d2e166442.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 00:01:20,966 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 6d6cb2271a4a80ef4703953d2e166442, disabling compactions & flushes 2023-09-27 00:01:20,967 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695772880925.6d6cb2271a4a80ef4703953d2e166442. 2023-09-27 00:01:20,967 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695772880925.6d6cb2271a4a80ef4703953d2e166442. 2023-09-27 00:01:20,967 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695772880925.6d6cb2271a4a80ef4703953d2e166442. after waiting 0 ms 2023-09-27 00:01:20,967 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695772880925.6d6cb2271a4a80ef4703953d2e166442. 2023-09-27 00:01:20,967 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695772880925.6d6cb2271a4a80ef4703953d2e166442. 2023-09-27 00:01:20,967 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 6d6cb2271a4a80ef4703953d2e166442: 2023-09-27 00:01:20,968 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695772880925.f038c684f3727a946ef1f9d1672181b0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 00:01:20,968 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing f038c684f3727a946ef1f9d1672181b0, disabling compactions & flushes 2023-09-27 00:01:20,969 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695772880925.f038c684f3727a946ef1f9d1672181b0. 2023-09-27 00:01:20,969 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695772880925.f038c684f3727a946ef1f9d1672181b0. 2023-09-27 00:01:20,969 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695772880925.f038c684f3727a946ef1f9d1672181b0. after waiting 0 ms 2023-09-27 00:01:20,969 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695772880925.f038c684f3727a946ef1f9d1672181b0. 2023-09-27 00:01:20,969 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695772880925.f038c684f3727a946ef1f9d1672181b0. 2023-09-27 00:01:20,969 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for f038c684f3727a946ef1f9d1672181b0: 2023-09-27 00:01:20,971 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-27 00:01:20,972 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695772880925.6d6cb2271a4a80ef4703953d2e166442.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695772880972"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695772880972"}]},"ts":"1695772880972"} 2023-09-27 00:01:20,972 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695772880925.f038c684f3727a946ef1f9d1672181b0.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695772880972"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695772880972"}]},"ts":"1695772880972"} 2023-09-27 00:01:20,975 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-27 00:01:20,976 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-27 00:01:20,977 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695772880976"}]},"ts":"1695772880976"} 2023-09-27 00:01:20,978 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-09-27 00:01:20,982 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-09-27 00:01:20,983 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 00:01:20,983 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 00:01:20,983 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 00:01:20,983 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 00:01:20,983 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6d6cb2271a4a80ef4703953d2e166442, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f038c684f3727a946ef1f9d1672181b0, ASSIGN}] 2023-09-27 00:01:20,985 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f038c684f3727a946ef1f9d1672181b0, ASSIGN 2023-09-27 00:01:20,985 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6d6cb2271a4a80ef4703953d2e166442, ASSIGN 2023-09-27 00:01:20,986 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f038c684f3727a946ef1f9d1672181b0, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,41703,1695772857103; forceNewPlan=false, retain=false 2023-09-27 00:01:20,986 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6d6cb2271a4a80ef4703953d2e166442, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,36739,1695772857140; forceNewPlan=false, retain=false 2023-09-27 00:01:21,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-27 00:01:21,137 INFO [jenkins-hbase9:33541] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-27 00:01:21,139 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=f038c684f3727a946ef1f9d1672181b0, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:21,139 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=6d6cb2271a4a80ef4703953d2e166442, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:21,140 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695772880925.f038c684f3727a946ef1f9d1672181b0.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695772881139"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695772881139"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695772881139"}]},"ts":"1695772881139"} 2023-09-27 00:01:21,140 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695772880925.6d6cb2271a4a80ef4703953d2e166442.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695772881139"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695772881139"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695772881139"}]},"ts":"1695772881139"} 2023-09-27 00:01:21,142 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 6d6cb2271a4a80ef4703953d2e166442, server=jenkins-hbase9.apache.org,36739,1695772857140}] 2023-09-27 00:01:21,143 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure f038c684f3727a946ef1f9d1672181b0, server=jenkins-hbase9.apache.org,41703,1695772857103}] 2023-09-27 00:01:21,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-27 00:01:21,299 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1695772880925.f038c684f3727a946ef1f9d1672181b0. 2023-09-27 00:01:21,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f038c684f3727a946ef1f9d1672181b0, NAME => 'testtb-testExportFileSystemState,1,1695772880925.f038c684f3727a946ef1f9d1672181b0.', STARTKEY => '1', ENDKEY => ''} 2023-09-27 00:01:21,299 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1695772880925.6d6cb2271a4a80ef4703953d2e166442. 2023-09-27 00:01:21,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1695772880925.f038c684f3727a946ef1f9d1672181b0. service=AccessControlService 2023-09-27 00:01:21,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6d6cb2271a4a80ef4703953d2e166442, NAME => 'testtb-testExportFileSystemState,,1695772880925.6d6cb2271a4a80ef4703953d2e166442.', STARTKEY => '', ENDKEY => '1'} 2023-09-27 00:01:21,300 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 00:01:21,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState f038c684f3727a946ef1f9d1672181b0 2023-09-27 00:01:21,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695772880925.f038c684f3727a946ef1f9d1672181b0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 00:01:21,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for f038c684f3727a946ef1f9d1672181b0 2023-09-27 00:01:21,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1695772880925.6d6cb2271a4a80ef4703953d2e166442. service=AccessControlService 2023-09-27 00:01:21,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for f038c684f3727a946ef1f9d1672181b0 2023-09-27 00:01:21,300 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 00:01:21,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 6d6cb2271a4a80ef4703953d2e166442 2023-09-27 00:01:21,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695772880925.6d6cb2271a4a80ef4703953d2e166442.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 00:01:21,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 6d6cb2271a4a80ef4703953d2e166442 2023-09-27 00:01:21,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 6d6cb2271a4a80ef4703953d2e166442 2023-09-27 00:01:21,302 INFO [StoreOpener-f038c684f3727a946ef1f9d1672181b0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f038c684f3727a946ef1f9d1672181b0 2023-09-27 00:01:21,302 INFO [StoreOpener-6d6cb2271a4a80ef4703953d2e166442-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6d6cb2271a4a80ef4703953d2e166442 2023-09-27 00:01:21,303 DEBUG [StoreOpener-f038c684f3727a946ef1f9d1672181b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemState/f038c684f3727a946ef1f9d1672181b0/cf 2023-09-27 00:01:21,303 DEBUG [StoreOpener-f038c684f3727a946ef1f9d1672181b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemState/f038c684f3727a946ef1f9d1672181b0/cf 2023-09-27 00:01:21,303 DEBUG [StoreOpener-6d6cb2271a4a80ef4703953d2e166442-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemState/6d6cb2271a4a80ef4703953d2e166442/cf 2023-09-27 00:01:21,303 DEBUG [StoreOpener-6d6cb2271a4a80ef4703953d2e166442-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemState/6d6cb2271a4a80ef4703953d2e166442/cf 2023-09-27 00:01:21,304 INFO [StoreOpener-f038c684f3727a946ef1f9d1672181b0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f038c684f3727a946ef1f9d1672181b0 columnFamilyName cf 2023-09-27 00:01:21,304 INFO [StoreOpener-6d6cb2271a4a80ef4703953d2e166442-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6d6cb2271a4a80ef4703953d2e166442 columnFamilyName cf 2023-09-27 00:01:21,305 INFO [StoreOpener-f038c684f3727a946ef1f9d1672181b0-1] regionserver.HStore(310): Store=f038c684f3727a946ef1f9d1672181b0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 00:01:21,305 INFO [StoreOpener-6d6cb2271a4a80ef4703953d2e166442-1] regionserver.HStore(310): Store=6d6cb2271a4a80ef4703953d2e166442/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 00:01:21,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemState/f038c684f3727a946ef1f9d1672181b0 2023-09-27 00:01:21,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemState/6d6cb2271a4a80ef4703953d2e166442 2023-09-27 00:01:21,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemState/f038c684f3727a946ef1f9d1672181b0 2023-09-27 00:01:21,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemState/6d6cb2271a4a80ef4703953d2e166442 2023-09-27 00:01:21,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 6d6cb2271a4a80ef4703953d2e166442 2023-09-27 00:01:21,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for f038c684f3727a946ef1f9d1672181b0 2023-09-27 00:01:21,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemState/f038c684f3727a946ef1f9d1672181b0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 00:01:21,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemState/6d6cb2271a4a80ef4703953d2e166442/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 00:01:21,315 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened f038c684f3727a946ef1f9d1672181b0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59313876, jitterRate=-0.11615437269210815}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 00:01:21,315 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 6d6cb2271a4a80ef4703953d2e166442; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72103732, jitterRate=0.07442933320999146}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 00:01:21,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for f038c684f3727a946ef1f9d1672181b0: 2023-09-27 00:01:21,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 6d6cb2271a4a80ef4703953d2e166442: 2023-09-27 00:01:21,316 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1695772880925.6d6cb2271a4a80ef4703953d2e166442., pid=30, masterSystemTime=1695772881295 2023-09-27 00:01:21,316 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1695772880925.f038c684f3727a946ef1f9d1672181b0., pid=31, masterSystemTime=1695772881295 2023-09-27 00:01:21,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1695772880925.6d6cb2271a4a80ef4703953d2e166442. 2023-09-27 00:01:21,318 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1695772880925.6d6cb2271a4a80ef4703953d2e166442. 2023-09-27 00:01:21,319 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=6d6cb2271a4a80ef4703953d2e166442, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:21,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1695772880925.f038c684f3727a946ef1f9d1672181b0. 2023-09-27 00:01:21,319 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1695772880925.f038c684f3727a946ef1f9d1672181b0. 2023-09-27 00:01:21,319 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1695772880925.6d6cb2271a4a80ef4703953d2e166442.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695772881319"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695772881319"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695772881319"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695772881319"}]},"ts":"1695772881319"} 2023-09-27 00:01:21,320 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=f038c684f3727a946ef1f9d1672181b0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:21,320 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1695772880925.f038c684f3727a946ef1f9d1672181b0.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695772881319"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695772881319"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695772881319"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695772881319"}]},"ts":"1695772881319"} 2023-09-27 00:01:21,326 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=28 2023-09-27 00:01:21,328 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=29 2023-09-27 00:01:21,329 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 6d6cb2271a4a80ef4703953d2e166442, server=jenkins-hbase9.apache.org,36739,1695772857140 in 179 msec 2023-09-27 00:01:21,329 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure f038c684f3727a946ef1f9d1672181b0, server=jenkins-hbase9.apache.org,41703,1695772857103 in 179 msec 2023-09-27 00:01:21,330 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6d6cb2271a4a80ef4703953d2e166442, ASSIGN in 345 msec 2023-09-27 00:01:21,331 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=29, resume processing ppid=27 2023-09-27 00:01:21,331 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f038c684f3727a946ef1f9d1672181b0, ASSIGN in 346 msec 2023-09-27 00:01:21,332 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-27 00:01:21,332 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695772881332"}]},"ts":"1695772881332"} 2023-09-27 00:01:21,334 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-09-27 00:01:21,337 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-27 00:01:21,338 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-09-27 00:01:21,340 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41869] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-27 00:01:21,341 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:01:21,341 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:01:21,341 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:01:21,341 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:01:21,343 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-27 00:01:21,343 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-27 00:01:21,343 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-27 00:01:21,343 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-27 00:01:21,344 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 417 msec 2023-09-27 00:01:21,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-27 00:01:21,536 INFO [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-09-27 00:01:21,539 DEBUG [Listener at jenkins-hbase9.apache.org/45033] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-27 00:01:21,539 DEBUG [Listener at jenkins-hbase9.apache.org/45033] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695772880925.6d6cb2271a4a80ef4703953d2e166442. 2023-09-27 00:01:21,542 INFO [Listener at jenkins-hbase9.apache.org/45033] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 00:01:21,555 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 00:01:21,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695772881555 (current time:1695772881555). 2023-09-27 00:01:21,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 00:01:21,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(139): Connect 0x0bceefd5 to 127.0.0.1:57983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 00:01:21,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f828e46, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 00:01:21,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 00:01:21,567 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:59740, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 00:01:21,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0bceefd5 to 127.0.0.1:57983 2023-09-27 00:01:21,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 00:01:21,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(139): Connect 0x4b2b4f8a to 127.0.0.1:57983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 00:01:21,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3767b17d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 00:01:21,576 DEBUG [hconnection-0x7cdce969-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 00:01:21,577 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:59742, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 00:01:21,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4b2b4f8a to 127.0.0.1:57983 2023-09-27 00:01:21,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 00:01:21,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-27 00:01:21,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 00:01:21,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 00:01:21,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-27 00:01:21,586 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-27 00:01:21,587 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695773481587 2023-09-27 00:01:21,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 00:01:21,588 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-27 00:01:21,588 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 00:01:21,589 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 00:01:21,590 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-27 00:01:21,590 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-27 00:01:21,592 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-09-27 00:01:21,592 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-27 00:01:21,593 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695773481593 2023-09-27 00:01:21,611 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,611 INFO [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-09-27 00:01:21,611 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:01:21,612 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-09-27 00:01:21,612 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-27 00:01:21,613 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,613 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,614 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:01:21,614 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:21,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:01:21,614 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:01:21,614 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:01:21,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:01:21,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:01:21,615 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:21,615 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:21,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:01:21,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:01:21,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:01:21,615 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:21,615 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 00:01:21,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,616 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,616 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,616 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-27 00:01:21,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-27 00:01:21,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-27 00:01:21,616 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-27 00:01:21,617 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-27 00:01:21,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,617 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,617 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-27 00:01:21,617 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,617 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-27 00:01:21,617 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:01:21,617 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-27 00:01:21,618 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-27 00:01:21,618 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-27 00:01:21,618 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41703,1695772857103' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-27 00:01:21,617 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,618 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:01:21,618 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-27 00:01:21,619 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-27 00:01:21,619 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-27 00:01:21,619 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:01:21,619 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41869,1695772857056' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-27 00:01:21,620 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-27 00:01:21,620 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-27 00:01:21,620 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,36739,1695772857140' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-27 00:01:21,622 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:21,622 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:21,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:01:21,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:01:21,632 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,632 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:21,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:01:21,632 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,633 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 00:01:21,632 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,633 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,633 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 00:01:21,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:01:21,633 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,633 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 00:01:21,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:21,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:21,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:21,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:01:21,634 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,41703,1695772857103' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-27 00:01:21,635 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@28961bac[Count = 1] remaining members to acquire global barrier 2023-09-27 00:01:21,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:21,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:01:21,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:01:21,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:01:21,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:01:21,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:21,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:21,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:21,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:01:21,637 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,36739,1695772857140' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-27 00:01:21,637 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@28961bac[Count = 0] remaining members to acquire global barrier 2023-09-27 00:01:21,637 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-27 00:01:21,637 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,639 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,639 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,640 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-27 00:01:21,640 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-27 00:01:21,639 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,640 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-27 00:01:21,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,640 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:21,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,640 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,41869,1695772857056' in zk 2023-09-27 00:01:21,640 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-27 00:01:21,640 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 00:01:21,640 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695772880925.6d6cb2271a4a80ef4703953d2e166442. 2023-09-27 00:01:21,640 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 00:01:21,640 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695772880925.6d6cb2271a4a80ef4703953d2e166442. started... 2023-09-27 00:01:21,640 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695772880925.f038c684f3727a946ef1f9d1672181b0. 2023-09-27 00:01:21,640 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 00:01:21,640 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695772880925.f038c684f3727a946ef1f9d1672181b0. started... 2023-09-27 00:01:21,640 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:21,641 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 00:01:21,640 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 00:01:21,640 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6d6cb2271a4a80ef4703953d2e166442: 2023-09-27 00:01:21,642 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f038c684f3727a946ef1f9d1672181b0: 2023-09-27 00:01:21,642 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695772880925.6d6cb2271a4a80ef4703953d2e166442.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,642 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695772880925.f038c684f3727a946ef1f9d1672181b0.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,642 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 00:01:21,642 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 00:01:21,642 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 00:01:21,642 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 00:01:21,642 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-27 00:01:21,642 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:01:21,642 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-27 00:01:21,666 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695772880925.6d6cb2271a4a80ef4703953d2e166442. completed. 2023-09-27 00:01:21,666 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695772880925.6d6cb2271a4a80ef4703953d2e166442. 2023-09-27 00:01:21,666 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 00:01:21,666 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 00:01:21,666 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:21,666 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-27 00:01:21,666 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,36739,1695772857140' in zk 2023-09-27 00:01:21,666 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695772880925.f038c684f3727a946ef1f9d1672181b0. completed. 2023-09-27 00:01:21,666 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695772880925.f038c684f3727a946ef1f9d1672181b0. 2023-09-27 00:01:21,667 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 00:01:21,667 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 00:01:21,667 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:21,667 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-27 00:01:21,667 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,41703,1695772857103' in zk 2023-09-27 00:01:21,668 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-27 00:01:21,668 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:21,668 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:01:21,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:21,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:01:21,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:01:21,668 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-27 00:01:21,670 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:21,670 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-27 00:01:21,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:01:21,670 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:01:21,670 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-27 00:01:21,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:01:21,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:21,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:21,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:21,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:01:21,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:21,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:21,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:21,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,36739,1695772857140': 2023-09-27 00:01:21,675 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,36739,1695772857140' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-27 00:01:21,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:21,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:01:21,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:01:21,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:01:21,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:01:21,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:21,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:21,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:21,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:01:21,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:21,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:21,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:21,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,41703,1695772857103': 2023-09-27 00:01:21,678 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,41703,1695772857103' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-27 00:01:21,678 INFO [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-09-27 00:01:21,678 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 00:01:21,678 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 00:01:21,678 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,678 INFO [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 00:01:21,681 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,681 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,681 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,681 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,681 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:01:21,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,681 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:01:21,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:01:21,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:01:21,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:01:21,681 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:01:21,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:01:21,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:01:21,681 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:21,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:01:21,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:01:21,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:01:21,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:01:21,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,682 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:21,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,683 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:21,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:01:21,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:21,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:21,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:21,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:01:21,685 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:21,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,685 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:21,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:21,685 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:21,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:21,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:21,688 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:21,688 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,688 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:01:21,688 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:01:21,688 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:01:21,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:01:21,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:01:21,688 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:21,689 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 00:01:21,689 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:21,689 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:01:21,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:01:21,689 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:01:21,689 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:01:21,689 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:01:21,688 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:01:21,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:01:21,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:01:21,689 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-27 00:01:21,689 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,691 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:21,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:01:21,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:01:21,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:01:21,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:01:21,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-27 00:01:21,691 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-27 00:01:21,691 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,691 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 00:01:21,692 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:21,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:01:21,692 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 00:01:21,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:01:21,692 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:21,692 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,692 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,692 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-27 00:01:21,700 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,701 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,722 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,723 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-27 00:01:21,723 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,723 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:21,724 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695772881588Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695772881700 (+112 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1695772881700Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1695772881700Writing data manifest for emptySnaptb0-testExportFileSystemState at 1695772881706 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1695772881715 (+9 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695772881723 (+8 ms) 2023-09-27 00:01:21,726 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-27 00:01:21,728 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 137 msec 2023-09-27 00:01:21,892 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 00:01:21,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-27 00:01:21,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 00:01:21,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36739] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1695772880925.6d6cb2271a4a80ef4703953d2e166442. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 00:01:21,902 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41703] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1695772880925.f038c684f3727a946ef1f9d1672181b0. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 00:01:21,906 DEBUG [Listener at jenkins-hbase9.apache.org/45033] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-27 00:01:21,906 DEBUG [Listener at jenkins-hbase9.apache.org/45033] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695772880925.6d6cb2271a4a80ef4703953d2e166442. 2023-09-27 00:01:21,906 INFO [Listener at jenkins-hbase9.apache.org/45033] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 00:01:21,918 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 00:01:21,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695772881918 (current time:1695772881918). 2023-09-27 00:01:21,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 00:01:21,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(139): Connect 0x33a28039 to 127.0.0.1:57983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 00:01:21,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@720e4f14, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 00:01:21,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 00:01:21,932 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:59756, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 00:01:21,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x33a28039 to 127.0.0.1:57983 2023-09-27 00:01:21,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 00:01:21,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(139): Connect 0x4d5c77f7 to 127.0.0.1:57983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 00:01:21,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6aae119d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 00:01:21,944 DEBUG [hconnection-0x78b4f339-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 00:01:21,947 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:59758, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 00:01:21,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4d5c77f7 to 127.0.0.1:57983 2023-09-27 00:01:21,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 00:01:21,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-27 00:01:21,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 00:01:21,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 00:01:21,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-27 00:01:21,957 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-27 00:01:21,958 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695773481958 2023-09-27 00:01:21,959 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-27 00:01:21,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 00:01:21,960 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 00:01:21,960 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 00:01:21,962 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-27 00:01:21,962 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-27 00:01:21,963 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-09-27 00:01:21,964 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-27 00:01:21,966 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695773481966 2023-09-27 00:01:21,978 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-09-27 00:01:21,978 INFO [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-09-27 00:01:21,978 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:01:21,980 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-09-27 00:01:21,980 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-27 00:01:21,980 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 00:01:21,980 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-27 00:01:21,982 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:01:21,982 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:01:21,982 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:01:21,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:01:21,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:01:21,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:01:21,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:01:21,982 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:21,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:01:21,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:01:21,982 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:21,982 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:21,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-27 00:01:21,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-27 00:01:21,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-27 00:01:21,983 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 00:01:21,983 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:21,983 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 00:01:21,983 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 00:01:21,983 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 00:01:21,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-27 00:01:21,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-27 00:01:21,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-27 00:01:21,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-27 00:01:21,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-27 00:01:21,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-27 00:01:21,984 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-27 00:01:21,984 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-27 00:01:21,984 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-27 00:01:21,984 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-27 00:01:21,984 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-27 00:01:21,984 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-27 00:01:21,984 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-27 00:01:21,984 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-27 00:01:21,984 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-27 00:01:21,985 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:01:21,984 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:01:21,986 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-27 00:01:21,987 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-27 00:01:21,987 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-27 00:01:21,984 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:01:21,987 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,36739,1695772857140' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-27 00:01:21,987 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-27 00:01:21,988 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-27 00:01:21,988 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-27 00:01:21,988 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41703,1695772857103' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-27 00:01:21,988 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41869,1695772857056' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-27 00:01:21,990 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:21,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:21,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:01:21,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:01:21,990 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 00:01:21,992 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:21,992 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 00:01:21,992 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 00:01:21,992 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 00:01:21,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:01:21,992 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 00:01:21,992 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 00:01:21,993 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 00:01:21,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:01:21,993 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 00:01:21,993 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 00:01:21,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-27 00:01:21,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:21,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:21,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:21,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:01:21,994 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,36739,1695772857140' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-27 00:01:21,994 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7560d949[Count = 1] remaining members to acquire global barrier 2023-09-27 00:01:21,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:21,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:01:21,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:01:21,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:01:21,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:01:21,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-27 00:01:21,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:21,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:21,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:21,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:01:21,997 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,41703,1695772857103' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-27 00:01:21,997 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7560d949[Count = 0] remaining members to acquire global barrier 2023-09-27 00:01:21,997 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-27 00:01:21,997 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 00:01:21,998 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 00:01:21,998 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 00:01:21,998 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 00:01:21,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 00:01:21,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 00:01:21,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 00:01:21,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 00:01:21,998 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:21,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 00:01:21,998 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-27 00:01:21,998 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-27 00:01:21,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 00:01:21,999 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 00:01:21,999 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 00:01:21,999 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 00:01:21,999 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 00:01:21,999 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-27 00:01:21,999 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695772880925.6d6cb2271a4a80ef4703953d2e166442. 2023-09-27 00:01:21,999 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:21,999 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 00:01:21,999 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695772880925.f038c684f3727a946ef1f9d1672181b0. 2023-09-27 00:01:21,999 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695772880925.6d6cb2271a4a80ef4703953d2e166442. started... 2023-09-27 00:01:21,999 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695772880925.f038c684f3727a946ef1f9d1672181b0. started... 2023-09-27 00:01:21,999 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-27 00:01:21,999 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,41869,1695772857056' in zk 2023-09-27 00:01:21,999 INFO [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6d6cb2271a4a80ef4703953d2e166442 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-27 00:01:21,999 INFO [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f038c684f3727a946ef1f9d1672181b0 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-27 00:01:22,001 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-27 00:01:22,001 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:01:22,001 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-27 00:01:22,039 INFO [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309271d39e5020bcd443f973012a9ff759f35 to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309271d39e5020bcd443f973012a9ff759f35 2023-09-27 00:01:22,045 INFO [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230927bbdbb0158b864284a19c469b7044201f to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230927bbdbb0158b864284a19c469b7044201f 2023-09-27 00:01:22,056 INFO [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemState/6d6cb2271a4a80ef4703953d2e166442/.tmp/cf/cc047190ba9a47ff8b1b821264b49278 2023-09-27 00:01:22,061 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 00:01:22,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-27 00:01:22,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-27 00:01:22,063 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 00:01:22,063 INFO [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemState/f038c684f3727a946ef1f9d1672181b0/.tmp/cf/e838cb26dbf1422ea000c2ed485a49fe 2023-09-27 00:01:22,066 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemState/6d6cb2271a4a80ef4703953d2e166442/.tmp/cf/cc047190ba9a47ff8b1b821264b49278 as hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemState/6d6cb2271a4a80ef4703953d2e166442/cf/cc047190ba9a47ff8b1b821264b49278 2023-09-27 00:01:22,070 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemState/f038c684f3727a946ef1f9d1672181b0/.tmp/cf/e838cb26dbf1422ea000c2ed485a49fe as hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemState/f038c684f3727a946ef1f9d1672181b0/cf/e838cb26dbf1422ea000c2ed485a49fe 2023-09-27 00:01:22,073 INFO [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemState/6d6cb2271a4a80ef4703953d2e166442/cf/cc047190ba9a47ff8b1b821264b49278, entries=4, sequenceid=6, filesize=5.6 K 2023-09-27 00:01:22,074 INFO [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 6d6cb2271a4a80ef4703953d2e166442 in 75ms, sequenceid=6, compaction requested=false 2023-09-27 00:01:22,074 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-27 00:01:22,075 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6d6cb2271a4a80ef4703953d2e166442: 2023-09-27 00:01:22,075 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695772880925.6d6cb2271a4a80ef4703953d2e166442.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-27 00:01:22,075 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 00:01:22,075 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemState/6d6cb2271a4a80ef4703953d2e166442/cf/cc047190ba9a47ff8b1b821264b49278] hfiles 2023-09-27 00:01:22,075 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemState/6d6cb2271a4a80ef4703953d2e166442/cf/cc047190ba9a47ff8b1b821264b49278 for snapshot=snaptb0-testExportFileSystemState 2023-09-27 00:01:22,076 INFO [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemState/f038c684f3727a946ef1f9d1672181b0/cf/e838cb26dbf1422ea000c2ed485a49fe, entries=46, sequenceid=6, filesize=12.7 K 2023-09-27 00:01:22,077 INFO [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for f038c684f3727a946ef1f9d1672181b0 in 78ms, sequenceid=6, compaction requested=false 2023-09-27 00:01:22,079 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f038c684f3727a946ef1f9d1672181b0: 2023-09-27 00:01:22,079 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695772880925.f038c684f3727a946ef1f9d1672181b0.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-27 00:01:22,079 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 00:01:22,079 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemState/f038c684f3727a946ef1f9d1672181b0/cf/e838cb26dbf1422ea000c2ed485a49fe] hfiles 2023-09-27 00:01:22,079 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemState/f038c684f3727a946ef1f9d1672181b0/cf/e838cb26dbf1422ea000c2ed485a49fe for snapshot=snaptb0-testExportFileSystemState 2023-09-27 00:01:22,100 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695772880925.f038c684f3727a946ef1f9d1672181b0. completed. 2023-09-27 00:01:22,100 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695772880925.f038c684f3727a946ef1f9d1672181b0. 2023-09-27 00:01:22,101 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 00:01:22,101 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 00:01:22,101 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:22,101 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-27 00:01:22,101 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,41703,1695772857103' in zk 2023-09-27 00:01:22,103 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695772880925.6d6cb2271a4a80ef4703953d2e166442. completed. 2023-09-27 00:01:22,103 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695772880925.6d6cb2271a4a80ef4703953d2e166442. 2023-09-27 00:01:22,103 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 00:01:22,103 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 00:01:22,103 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:22,103 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-27 00:01:22,103 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,36739,1695772857140' in zk 2023-09-27 00:01:22,107 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-27 00:01:22,107 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:22,107 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:01:22,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:22,107 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-27 00:01:22,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:01:22,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:01:22,109 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:22,109 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-27 00:01:22,109 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:01:22,109 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-27 00:01:22,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:01:22,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:01:22,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-27 00:01:22,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:22,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:22,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:22,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:01:22,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-27 00:01:22,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:22,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:22,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:22,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,41703,1695772857103': 2023-09-27 00:01:22,115 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,41703,1695772857103' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-27 00:01:22,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:22,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:01:22,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:01:22,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:01:22,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:01:22,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-27 00:01:22,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:22,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:22,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:22,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:01:22,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-27 00:01:22,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:22,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:22,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:22,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,36739,1695772857140': 2023-09-27 00:01:22,119 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,36739,1695772857140' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-27 00:01:22,119 INFO [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-09-27 00:01:22,119 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 00:01:22,119 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 00:01:22,119 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-09-27 00:01:22,119 INFO [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 00:01:22,121 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 00:01:22,121 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 00:01:22,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 00:01:22,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 00:01:22,121 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:01:22,121 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 00:01:22,121 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 00:01:22,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 00:01:22,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 00:01:22,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 00:01:22,121 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:01:22,121 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:01:22,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 00:01:22,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:01:22,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:01:22,121 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:22,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 00:01:22,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:01:22,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:01:22,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:01:22,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:01:22,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:01:22,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:01:22,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:01:22,122 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:22,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 00:01:22,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 00:01:22,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 00:01:22,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-27 00:01:22,123 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:22,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:01:22,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-27 00:01:22,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:22,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:22,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:22,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:01:22,125 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:22,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-27 00:01:22,125 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:22,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:22,125 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:22,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:22,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:22,130 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:22,130 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-27 00:01:22,130 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:01:22,130 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:01:22,130 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:22,130 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:01:22,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:01:22,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:01:22,130 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:01:22,130 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:01:22,130 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:22,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:01:22,130 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:01:22,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:01:22,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:01:22,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:01:22,131 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-27 00:01:22,131 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:01:22,130 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-09-27 00:01:22,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:01:22,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:01:22,132 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:22,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:01:22,132 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-27 00:01:22,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:01:22,132 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 00:01:22,132 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:22,132 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:22,132 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 00:01:22,132 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 00:01:22,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:01:22,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:01:22,132 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-27 00:01:22,133 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 00:01:22,134 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230927bbdbb0158b864284a19c469b7044201f, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309271d39e5020bcd443f973012a9ff759f35] mob files 2023-09-27 00:01:22,134 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230927bbdbb0158b864284a19c469b7044201f 2023-09-27 00:01:22,134 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309271d39e5020bcd443f973012a9ff759f35 2023-09-27 00:01:22,145 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-09-27 00:01:22,146 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-27 00:01:22,173 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-27 00:01:22,174 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-27 00:01:22,174 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-27 00:01:22,174 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-27 00:01:22,174 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695772881959Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695772882145 (+186 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1695772882145Loading Region manifests for snaptb0-testExportFileSystemState at 1695772882145Writing data manifest for snaptb0-testExportFileSystemState at 1695772882149 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1695772882160 (+11 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695772882174 (+14 ms) 2023-09-27 00:01:22,177 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-27 00:01:22,179 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 217 msec 2023-09-27 00:01:22,263 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 00:01:22,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-27 00:01:22,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 00:01:22,265 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772882265 2023-09-27 00:01:22,265 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40313, tgtDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772882265, rawTgtDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772882265, srcFsUri=hdfs://localhost:40313, srcDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8 2023-09-27 00:01:22,293 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40313, inputRoot=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8 2023-09-27 00:01:22,293 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1576495093_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772882265, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772882265/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-27 00:01:22,293 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40313, inputRoot=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8, snapshotDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-09-27 00:01:22,312 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772882265/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-27 00:01:22,346 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-27 00:01:22,347 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-27 00:01:22,347 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-27 00:01:22,348 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-27 00:01:23,221 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/hadoop-5952594206840346444.jar 2023-09-27 00:01:23,221 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-27 00:01:23,222 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-27 00:01:23,295 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/hadoop-5668142177468138167.jar 2023-09-27 00:01:23,295 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-27 00:01:23,296 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-27 00:01:23,296 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-27 00:01:23,296 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-27 00:01:23,297 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-27 00:01:23,297 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-27 00:01:23,298 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-27 00:01:23,298 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-27 00:01:23,298 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-27 00:01:23,299 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-27 00:01:23,299 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-27 00:01:23,300 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-27 00:01:23,300 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-27 00:01:23,300 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-27 00:01:23,301 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-27 00:01:23,301 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-27 00:01:23,302 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 00:01:23,302 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 00:01:23,303 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 00:01:23,304 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 00:01:23,304 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 00:01:23,305 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 00:01:23,306 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 00:01:23,809 WARN [Listener at jenkins-hbase9.apache.org/45033] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-27 00:01:23,812 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-09-27 00:01:23,815 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-27 00:01:24,611 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 00:01:24,611 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 00:01:24,617 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695772863328_0001_000001 (auth:SIMPLE) 2023-09-27 00:01:25,280 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695772863328_0002_000001 (auth:SIMPLE) 2023-09-27 00:01:26,241 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-27 00:01:29,219 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695772863328_0002_000001 (auth:SIMPLE) 2023-09-27 00:01:31,443 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695772863328_0002_000001 (auth:SIMPLE) 2023-09-27 00:01:34,077 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695772863328_0002_000001 (auth:SIMPLE) 2023-09-27 00:01:36,010 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-27 00:01:36,011 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-27 00:01:36,020 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-09-27 00:01:36,020 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-27 00:01:36,021 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-27 00:01:36,021 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-728144799_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-27 00:01:36,021 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(367): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-27 00:01:36,021 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(367): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-27 00:01:36,021 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-728144799_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772882265/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772882265/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-27 00:01:36,022 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(367): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772882265/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-27 00:01:36,022 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(367): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772882265/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-27 00:01:36,029 INFO [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-09-27 00:01:36,029 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemState 2023-09-27 00:01:36,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-09-27 00:01:36,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-27 00:01:36,034 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695772896034"}]},"ts":"1695772896034"} 2023-09-27 00:01:36,036 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-09-27 00:01:36,037 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-09-27 00:01:36,038 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6d6cb2271a4a80ef4703953d2e166442, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f038c684f3727a946ef1f9d1672181b0, UNASSIGN}] 2023-09-27 00:01:36,041 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6d6cb2271a4a80ef4703953d2e166442, UNASSIGN 2023-09-27 00:01:36,041 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f038c684f3727a946ef1f9d1672181b0, UNASSIGN 2023-09-27 00:01:36,041 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=6d6cb2271a4a80ef4703953d2e166442, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:36,042 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695772880925.6d6cb2271a4a80ef4703953d2e166442.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695772896041"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695772896041"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695772896041"}]},"ts":"1695772896041"} 2023-09-27 00:01:36,042 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=f038c684f3727a946ef1f9d1672181b0, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:36,042 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695772880925.f038c684f3727a946ef1f9d1672181b0.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695772896042"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695772896042"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695772896042"}]},"ts":"1695772896042"} 2023-09-27 00:01:36,043 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 6d6cb2271a4a80ef4703953d2e166442, server=jenkins-hbase9.apache.org,36739,1695772857140}] 2023-09-27 00:01:36,044 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure f038c684f3727a946ef1f9d1672181b0, server=jenkins-hbase9.apache.org,41703,1695772857103}] 2023-09-27 00:01:36,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-27 00:01:36,195 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 6d6cb2271a4a80ef4703953d2e166442 2023-09-27 00:01:36,195 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close f038c684f3727a946ef1f9d1672181b0 2023-09-27 00:01:36,196 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 6d6cb2271a4a80ef4703953d2e166442, disabling compactions & flushes 2023-09-27 00:01:36,196 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing f038c684f3727a946ef1f9d1672181b0, disabling compactions & flushes 2023-09-27 00:01:36,196 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695772880925.6d6cb2271a4a80ef4703953d2e166442. 2023-09-27 00:01:36,196 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695772880925.f038c684f3727a946ef1f9d1672181b0. 2023-09-27 00:01:36,196 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695772880925.6d6cb2271a4a80ef4703953d2e166442. 2023-09-27 00:01:36,196 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695772880925.f038c684f3727a946ef1f9d1672181b0. 2023-09-27 00:01:36,196 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695772880925.6d6cb2271a4a80ef4703953d2e166442. after waiting 0 ms 2023-09-27 00:01:36,196 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695772880925.6d6cb2271a4a80ef4703953d2e166442. 2023-09-27 00:01:36,196 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695772880925.f038c684f3727a946ef1f9d1672181b0. after waiting 0 ms 2023-09-27 00:01:36,196 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695772880925.f038c684f3727a946ef1f9d1672181b0. 2023-09-27 00:01:36,204 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemState/6d6cb2271a4a80ef4703953d2e166442/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 00:01:36,204 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemState/f038c684f3727a946ef1f9d1672181b0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 00:01:36,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 00:01:36,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 00:01:36,206 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695772880925.6d6cb2271a4a80ef4703953d2e166442. 2023-09-27 00:01:36,207 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695772880925.f038c684f3727a946ef1f9d1672181b0. 2023-09-27 00:01:36,207 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 6d6cb2271a4a80ef4703953d2e166442: 2023-09-27 00:01:36,207 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for f038c684f3727a946ef1f9d1672181b0: 2023-09-27 00:01:36,209 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 6d6cb2271a4a80ef4703953d2e166442 2023-09-27 00:01:36,209 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=6d6cb2271a4a80ef4703953d2e166442, regionState=CLOSED 2023-09-27 00:01:36,209 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695772880925.6d6cb2271a4a80ef4703953d2e166442.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695772896209"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695772896209"}]},"ts":"1695772896209"} 2023-09-27 00:01:36,210 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed f038c684f3727a946ef1f9d1672181b0 2023-09-27 00:01:36,210 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=f038c684f3727a946ef1f9d1672181b0, regionState=CLOSED 2023-09-27 00:01:36,210 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695772880925.f038c684f3727a946ef1f9d1672181b0.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695772896210"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695772896210"}]},"ts":"1695772896210"} 2023-09-27 00:01:36,214 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=37 2023-09-27 00:01:36,214 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 6d6cb2271a4a80ef4703953d2e166442, server=jenkins-hbase9.apache.org,36739,1695772857140 in 168 msec 2023-09-27 00:01:36,214 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=38 2023-09-27 00:01:36,214 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure f038c684f3727a946ef1f9d1672181b0, server=jenkins-hbase9.apache.org,41703,1695772857103 in 168 msec 2023-09-27 00:01:36,215 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6d6cb2271a4a80ef4703953d2e166442, UNASSIGN in 176 msec 2023-09-27 00:01:36,216 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=38, resume processing ppid=36 2023-09-27 00:01:36,217 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f038c684f3727a946ef1f9d1672181b0, UNASSIGN in 176 msec 2023-09-27 00:01:36,217 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695772896217"}]},"ts":"1695772896217"} 2023-09-27 00:01:36,218 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-09-27 00:01:36,220 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-09-27 00:01:36,222 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 192 msec 2023-09-27 00:01:36,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-27 00:01:36,336 INFO [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-09-27 00:01:36,337 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemState 2023-09-27 00:01:36,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-27 00:01:36,340 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-27 00:01:36,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-09-27 00:01:36,341 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-27 00:01:36,343 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41869] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-09-27 00:01:36,346 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-27 00:01:36,346 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-27 00:01:36,346 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-27 00:01:36,346 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemState/6d6cb2271a4a80ef4703953d2e166442 2023-09-27 00:01:36,346 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-27 00:01:36,346 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemState/f038c684f3727a946ef1f9d1672181b0 2023-09-27 00:01:36,347 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-27 00:01:36,347 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-27 00:01:36,347 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-27 00:01:36,347 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-27 00:01:36,348 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-27 00:01:36,348 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-27 00:01:36,348 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-27 00:01:36,348 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-27 00:01:36,348 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:01:36,348 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:01:36,348 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:01:36,348 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:01:36,349 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemState/6d6cb2271a4a80ef4703953d2e166442/cf, FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemState/6d6cb2271a4a80ef4703953d2e166442/recovered.edits] 2023-09-27 00:01:36,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-27 00:01:36,349 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemState/f038c684f3727a946ef1f9d1672181b0/cf, FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemState/f038c684f3727a946ef1f9d1672181b0/recovered.edits] 2023-09-27 00:01:36,353 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemState/f038c684f3727a946ef1f9d1672181b0/cf/e838cb26dbf1422ea000c2ed485a49fe to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/archive/data/default/testtb-testExportFileSystemState/f038c684f3727a946ef1f9d1672181b0/cf/e838cb26dbf1422ea000c2ed485a49fe 2023-09-27 00:01:36,356 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemState/f038c684f3727a946ef1f9d1672181b0/recovered.edits/9.seqid to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/archive/data/default/testtb-testExportFileSystemState/f038c684f3727a946ef1f9d1672181b0/recovered.edits/9.seqid 2023-09-27 00:01:36,357 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemState/f038c684f3727a946ef1f9d1672181b0 2023-09-27 00:01:36,358 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemState/6d6cb2271a4a80ef4703953d2e166442/cf/cc047190ba9a47ff8b1b821264b49278 to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/archive/data/default/testtb-testExportFileSystemState/6d6cb2271a4a80ef4703953d2e166442/cf/cc047190ba9a47ff8b1b821264b49278 2023-09-27 00:01:36,361 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemState/6d6cb2271a4a80ef4703953d2e166442/recovered.edits/9.seqid to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/archive/data/default/testtb-testExportFileSystemState/6d6cb2271a4a80ef4703953d2e166442/recovered.edits/9.seqid 2023-09-27 00:01:36,361 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemState/6d6cb2271a4a80ef4703953d2e166442 2023-09-27 00:01:36,361 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-27 00:01:36,362 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-27 00:01:36,362 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-09-27 00:01:36,366 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230927bbdbb0158b864284a19c469b7044201f to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230927bbdbb0158b864284a19c469b7044201f 2023-09-27 00:01:36,367 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309271d39e5020bcd443f973012a9ff759f35 to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309271d39e5020bcd443f973012a9ff759f35 2023-09-27 00:01:36,367 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-27 00:01:36,370 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-27 00:01:36,372 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-09-27 00:01:36,375 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-09-27 00:01:36,376 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-27 00:01:36,377 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-09-27 00:01:36,377 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1695772880925.6d6cb2271a4a80ef4703953d2e166442.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695772896377"}]},"ts":"9223372036854775807"} 2023-09-27 00:01:36,377 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1695772880925.f038c684f3727a946ef1f9d1672181b0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695772896377"}]},"ts":"9223372036854775807"} 2023-09-27 00:01:36,379 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-27 00:01:36,379 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6d6cb2271a4a80ef4703953d2e166442, NAME => 'testtb-testExportFileSystemState,,1695772880925.6d6cb2271a4a80ef4703953d2e166442.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => f038c684f3727a946ef1f9d1672181b0, NAME => 'testtb-testExportFileSystemState,1,1695772880925.f038c684f3727a946ef1f9d1672181b0.', STARTKEY => '1', ENDKEY => ''}] 2023-09-27 00:01:36,379 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-09-27 00:01:36,380 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695772896380"}]},"ts":"9223372036854775807"} 2023-09-27 00:01:36,383 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-09-27 00:01:36,385 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-27 00:01:36,387 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 48 msec 2023-09-27 00:01:36,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-27 00:01:36,451 INFO [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-09-27 00:01:36,458 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportFileSystemState" 2023-09-27 00:01:36,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-09-27 00:01:36,462 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemState" 2023-09-27 00:01:36,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-09-27 00:01:36,488 INFO [Listener at jenkins-hbase9.apache.org/45033] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=765 (was 754) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1988502388) connection to jenkins-hbase9.apache.org/172.31.2.10:41981 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-728144799_17 at /127.0.0.1:55112 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-728144799_17 at /127.0.0.1:48452 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x49a14021-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x49a14021-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1962 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x49a14021-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1966402476_1 at /127.0.0.1:48428 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1988502388) connection to jenkins-hbase9.apache.org/172.31.2.10:45033 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x49a14021-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-728144799_17 at /127.0.0.1:44830 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=926 (was 928), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=259 (was 246) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=6748 (was 6842) 2023-09-27 00:01:36,488 WARN [Listener at jenkins-hbase9.apache.org/45033] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-09-27 00:01:36,507 INFO [Listener at jenkins-hbase9.apache.org/45033] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=764, OpenFileDescriptor=926, MaxFileDescriptor=60000, SystemLoadAverage=259, ProcessCount=168, AvailableMemoryMB=6747 2023-09-27 00:01:36,507 WARN [Listener at jenkins-hbase9.apache.org/45033] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-09-27 00:01:36,508 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-27 00:01:36,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-09-27 00:01:36,512 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-09-27 00:01:36,512 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-09-27 00:01:36,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-27 00:01:36,513 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-27 00:01:36,516 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testConsecutiveExports/9cce9cd89f83fedacc0910c7826fc4ba 2023-09-27 00:01:36,516 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testConsecutiveExports/02903f28fedd146e9c2436d5eea1bef5 2023-09-27 00:01:36,516 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testConsecutiveExports/9cce9cd89f83fedacc0910c7826fc4ba empty. 2023-09-27 00:01:36,516 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testConsecutiveExports/02903f28fedd146e9c2436d5eea1bef5 empty. 2023-09-27 00:01:36,517 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testConsecutiveExports/9cce9cd89f83fedacc0910c7826fc4ba 2023-09-27 00:01:36,517 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testConsecutiveExports/02903f28fedd146e9c2436d5eea1bef5 2023-09-27 00:01:36,517 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-27 00:01:36,541 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-09-27 00:01:36,542 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9cce9cd89f83fedacc0910c7826fc4ba, NAME => 'testtb-testConsecutiveExports,,1695772896508.9cce9cd89f83fedacc0910c7826fc4ba.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp 2023-09-27 00:01:36,542 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 02903f28fedd146e9c2436d5eea1bef5, NAME => 'testtb-testConsecutiveExports,1,1695772896508.02903f28fedd146e9c2436d5eea1bef5.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp 2023-09-27 00:01:36,566 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695772896508.02903f28fedd146e9c2436d5eea1bef5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 00:01:36,567 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 02903f28fedd146e9c2436d5eea1bef5, disabling compactions & flushes 2023-09-27 00:01:36,567 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695772896508.02903f28fedd146e9c2436d5eea1bef5. 2023-09-27 00:01:36,567 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695772896508.02903f28fedd146e9c2436d5eea1bef5. 2023-09-27 00:01:36,567 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695772896508.02903f28fedd146e9c2436d5eea1bef5. after waiting 0 ms 2023-09-27 00:01:36,567 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695772896508.02903f28fedd146e9c2436d5eea1bef5. 2023-09-27 00:01:36,567 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695772896508.02903f28fedd146e9c2436d5eea1bef5. 2023-09-27 00:01:36,567 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 02903f28fedd146e9c2436d5eea1bef5: 2023-09-27 00:01:36,569 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695772896508.9cce9cd89f83fedacc0910c7826fc4ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 00:01:36,569 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 9cce9cd89f83fedacc0910c7826fc4ba, disabling compactions & flushes 2023-09-27 00:01:36,569 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695772896508.9cce9cd89f83fedacc0910c7826fc4ba. 2023-09-27 00:01:36,569 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695772896508.9cce9cd89f83fedacc0910c7826fc4ba. 2023-09-27 00:01:36,569 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695772896508.9cce9cd89f83fedacc0910c7826fc4ba. after waiting 0 ms 2023-09-27 00:01:36,569 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695772896508.9cce9cd89f83fedacc0910c7826fc4ba. 2023-09-27 00:01:36,569 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695772896508.9cce9cd89f83fedacc0910c7826fc4ba. 2023-09-27 00:01:36,569 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 9cce9cd89f83fedacc0910c7826fc4ba: 2023-09-27 00:01:36,572 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-09-27 00:01:36,573 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695772896508.02903f28fedd146e9c2436d5eea1bef5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695772896573"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695772896573"}]},"ts":"1695772896573"} 2023-09-27 00:01:36,573 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695772896508.9cce9cd89f83fedacc0910c7826fc4ba.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695772896573"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695772896573"}]},"ts":"1695772896573"} 2023-09-27 00:01:36,575 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-27 00:01:36,577 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-27 00:01:36,577 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695772896577"}]},"ts":"1695772896577"} 2023-09-27 00:01:36,578 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-09-27 00:01:36,587 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-09-27 00:01:36,588 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 00:01:36,588 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 00:01:36,588 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 00:01:36,588 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 00:01:36,588 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9cce9cd89f83fedacc0910c7826fc4ba, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=02903f28fedd146e9c2436d5eea1bef5, ASSIGN}] 2023-09-27 00:01:36,591 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9cce9cd89f83fedacc0910c7826fc4ba, ASSIGN 2023-09-27 00:01:36,591 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=02903f28fedd146e9c2436d5eea1bef5, ASSIGN 2023-09-27 00:01:36,592 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9cce9cd89f83fedacc0910c7826fc4ba, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,41703,1695772857103; forceNewPlan=false, retain=false 2023-09-27 00:01:36,592 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=02903f28fedd146e9c2436d5eea1bef5, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,36739,1695772857140; forceNewPlan=false, retain=false 2023-09-27 00:01:36,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-27 00:01:36,742 INFO [jenkins-hbase9:33541] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-27 00:01:36,745 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=02903f28fedd146e9c2436d5eea1bef5, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:36,745 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=9cce9cd89f83fedacc0910c7826fc4ba, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:36,745 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695772896508.02903f28fedd146e9c2436d5eea1bef5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695772896745"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695772896745"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695772896745"}]},"ts":"1695772896745"} 2023-09-27 00:01:36,745 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695772896508.9cce9cd89f83fedacc0910c7826fc4ba.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695772896745"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695772896745"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695772896745"}]},"ts":"1695772896745"} 2023-09-27 00:01:36,747 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 02903f28fedd146e9c2436d5eea1bef5, server=jenkins-hbase9.apache.org,36739,1695772857140}] 2023-09-27 00:01:36,748 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 9cce9cd89f83fedacc0910c7826fc4ba, server=jenkins-hbase9.apache.org,41703,1695772857103}] 2023-09-27 00:01:36,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-27 00:01:36,902 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1695772896508.02903f28fedd146e9c2436d5eea1bef5. 2023-09-27 00:01:36,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 02903f28fedd146e9c2436d5eea1bef5, NAME => 'testtb-testConsecutiveExports,1,1695772896508.02903f28fedd146e9c2436d5eea1bef5.', STARTKEY => '1', ENDKEY => ''} 2023-09-27 00:01:36,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1695772896508.02903f28fedd146e9c2436d5eea1bef5. service=AccessControlService 2023-09-27 00:01:36,903 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 00:01:36,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 02903f28fedd146e9c2436d5eea1bef5 2023-09-27 00:01:36,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695772896508.02903f28fedd146e9c2436d5eea1bef5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 00:01:36,903 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1695772896508.9cce9cd89f83fedacc0910c7826fc4ba. 2023-09-27 00:01:36,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 02903f28fedd146e9c2436d5eea1bef5 2023-09-27 00:01:36,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 02903f28fedd146e9c2436d5eea1bef5 2023-09-27 00:01:36,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9cce9cd89f83fedacc0910c7826fc4ba, NAME => 'testtb-testConsecutiveExports,,1695772896508.9cce9cd89f83fedacc0910c7826fc4ba.', STARTKEY => '', ENDKEY => '1'} 2023-09-27 00:01:36,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1695772896508.9cce9cd89f83fedacc0910c7826fc4ba. service=AccessControlService 2023-09-27 00:01:36,904 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 00:01:36,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 9cce9cd89f83fedacc0910c7826fc4ba 2023-09-27 00:01:36,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695772896508.9cce9cd89f83fedacc0910c7826fc4ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 00:01:36,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 9cce9cd89f83fedacc0910c7826fc4ba 2023-09-27 00:01:36,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 9cce9cd89f83fedacc0910c7826fc4ba 2023-09-27 00:01:36,905 INFO [StoreOpener-02903f28fedd146e9c2436d5eea1bef5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 02903f28fedd146e9c2436d5eea1bef5 2023-09-27 00:01:36,905 INFO [StoreOpener-9cce9cd89f83fedacc0910c7826fc4ba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9cce9cd89f83fedacc0910c7826fc4ba 2023-09-27 00:01:36,906 DEBUG [StoreOpener-02903f28fedd146e9c2436d5eea1bef5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testConsecutiveExports/02903f28fedd146e9c2436d5eea1bef5/cf 2023-09-27 00:01:36,906 DEBUG [StoreOpener-02903f28fedd146e9c2436d5eea1bef5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testConsecutiveExports/02903f28fedd146e9c2436d5eea1bef5/cf 2023-09-27 00:01:36,907 INFO [StoreOpener-02903f28fedd146e9c2436d5eea1bef5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 02903f28fedd146e9c2436d5eea1bef5 columnFamilyName cf 2023-09-27 00:01:36,907 DEBUG [StoreOpener-9cce9cd89f83fedacc0910c7826fc4ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testConsecutiveExports/9cce9cd89f83fedacc0910c7826fc4ba/cf 2023-09-27 00:01:36,907 DEBUG [StoreOpener-9cce9cd89f83fedacc0910c7826fc4ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testConsecutiveExports/9cce9cd89f83fedacc0910c7826fc4ba/cf 2023-09-27 00:01:36,907 INFO [StoreOpener-9cce9cd89f83fedacc0910c7826fc4ba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9cce9cd89f83fedacc0910c7826fc4ba columnFamilyName cf 2023-09-27 00:01:36,908 INFO [StoreOpener-9cce9cd89f83fedacc0910c7826fc4ba-1] regionserver.HStore(310): Store=9cce9cd89f83fedacc0910c7826fc4ba/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 00:01:36,908 INFO [StoreOpener-02903f28fedd146e9c2436d5eea1bef5-1] regionserver.HStore(310): Store=02903f28fedd146e9c2436d5eea1bef5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 00:01:36,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testConsecutiveExports/9cce9cd89f83fedacc0910c7826fc4ba 2023-09-27 00:01:36,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testConsecutiveExports/02903f28fedd146e9c2436d5eea1bef5 2023-09-27 00:01:36,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testConsecutiveExports/9cce9cd89f83fedacc0910c7826fc4ba 2023-09-27 00:01:36,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testConsecutiveExports/02903f28fedd146e9c2436d5eea1bef5 2023-09-27 00:01:36,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 9cce9cd89f83fedacc0910c7826fc4ba 2023-09-27 00:01:36,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 02903f28fedd146e9c2436d5eea1bef5 2023-09-27 00:01:36,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testConsecutiveExports/9cce9cd89f83fedacc0910c7826fc4ba/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 00:01:36,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testConsecutiveExports/02903f28fedd146e9c2436d5eea1bef5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 00:01:36,916 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 9cce9cd89f83fedacc0910c7826fc4ba; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74034195, jitterRate=0.10319547355175018}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 00:01:36,916 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 02903f28fedd146e9c2436d5eea1bef5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63487609, jitterRate=-0.053960904479026794}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 00:01:36,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 9cce9cd89f83fedacc0910c7826fc4ba: 2023-09-27 00:01:36,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 02903f28fedd146e9c2436d5eea1bef5: 2023-09-27 00:01:36,917 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1695772896508.02903f28fedd146e9c2436d5eea1bef5., pid=45, masterSystemTime=1695772896899 2023-09-27 00:01:36,917 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1695772896508.9cce9cd89f83fedacc0910c7826fc4ba., pid=46, masterSystemTime=1695772896900 2023-09-27 00:01:36,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1695772896508.9cce9cd89f83fedacc0910c7826fc4ba. 2023-09-27 00:01:36,919 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1695772896508.9cce9cd89f83fedacc0910c7826fc4ba. 2023-09-27 00:01:36,920 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=9cce9cd89f83fedacc0910c7826fc4ba, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:36,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1695772896508.02903f28fedd146e9c2436d5eea1bef5. 2023-09-27 00:01:36,920 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1695772896508.02903f28fedd146e9c2436d5eea1bef5. 2023-09-27 00:01:36,920 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1695772896508.9cce9cd89f83fedacc0910c7826fc4ba.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695772896920"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695772896920"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695772896920"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695772896920"}]},"ts":"1695772896920"} 2023-09-27 00:01:36,920 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=02903f28fedd146e9c2436d5eea1bef5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:36,921 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1695772896508.02903f28fedd146e9c2436d5eea1bef5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695772896920"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695772896920"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695772896920"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695772896920"}]},"ts":"1695772896920"} 2023-09-27 00:01:36,924 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=43 2023-09-27 00:01:36,924 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 9cce9cd89f83fedacc0910c7826fc4ba, server=jenkins-hbase9.apache.org,41703,1695772857103 in 174 msec 2023-09-27 00:01:36,925 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-09-27 00:01:36,925 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 02903f28fedd146e9c2436d5eea1bef5, server=jenkins-hbase9.apache.org,36739,1695772857140 in 176 msec 2023-09-27 00:01:36,926 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9cce9cd89f83fedacc0910c7826fc4ba, ASSIGN in 336 msec 2023-09-27 00:01:36,927 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=42 2023-09-27 00:01:36,927 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=02903f28fedd146e9c2436d5eea1bef5, ASSIGN in 337 msec 2023-09-27 00:01:36,928 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-27 00:01:36,928 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695772896928"}]},"ts":"1695772896928"} 2023-09-27 00:01:36,929 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-09-27 00:01:36,932 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-09-27 00:01:36,932 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-09-27 00:01:36,934 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41869] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-27 00:01:36,935 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:01:36,935 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:01:36,935 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:01:36,935 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:01:36,937 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-27 00:01:36,937 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-27 00:01:36,937 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-27 00:01:36,937 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-27 00:01:36,938 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 429 msec 2023-09-27 00:01:37,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-27 00:01:37,117 INFO [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-09-27 00:01:37,119 DEBUG [Listener at jenkins-hbase9.apache.org/45033] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-27 00:01:37,119 DEBUG [Listener at jenkins-hbase9.apache.org/45033] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695772896508.9cce9cd89f83fedacc0910c7826fc4ba. 2023-09-27 00:01:37,121 INFO [Listener at jenkins-hbase9.apache.org/45033] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 00:01:37,131 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-27 00:01:37,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695772897131 (current time:1695772897131). 2023-09-27 00:01:37,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 00:01:37,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(139): Connect 0x46da8d4e to 127.0.0.1:57983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 00:01:37,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6c6e9c2a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 00:01:37,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 00:01:37,143 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43236, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 00:01:37,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x46da8d4e to 127.0.0.1:57983 2023-09-27 00:01:37,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 00:01:37,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(139): Connect 0x196939cc to 127.0.0.1:57983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 00:01:37,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@bcb6752, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 00:01:37,154 DEBUG [hconnection-0x135c35cd-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 00:01:37,156 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43238, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 00:01:37,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x196939cc to 127.0.0.1:57983 2023-09-27 00:01:37,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 00:01:37,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-27 00:01:37,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 00:01:37,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-27 00:01:37,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-27 00:01:37,164 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-27 00:01:37,165 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695773497165 2023-09-27 00:01:37,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-27 00:01:37,165 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-27 00:01:37,166 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 00:01:37,166 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 00:01:37,167 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-27 00:01:37,167 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-27 00:01:37,168 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-09-27 00:01:37,169 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-27 00:01:37,170 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695773497170 2023-09-27 00:01:37,182 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,182 INFO [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-09-27 00:01:37,182 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:01:37,183 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-09-27 00:01:37,183 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-27 00:01:37,184 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,184 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,186 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:01:37,186 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:37,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:01:37,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:01:37,186 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:01:37,186 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:01:37,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:01:37,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:01:37,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:01:37,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:01:37,186 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:37,187 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:37,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,187 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,187 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,187 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:37,187 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,187 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 00:01:37,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-27 00:01:37,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,187 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-27 00:01:37,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-27 00:01:37,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-27 00:01:37,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,188 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,188 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-27 00:01:37,188 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-27 00:01:37,188 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-27 00:01:37,188 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:01:37,188 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,190 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,190 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-27 00:01:37,190 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-27 00:01:37,190 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:01:37,189 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-27 00:01:37,191 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-27 00:01:37,191 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-27 00:01:37,191 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-27 00:01:37,191 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41869,1695772857056' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-27 00:01:37,190 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:01:37,191 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41703,1695772857103' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-27 00:01:37,194 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-27 00:01:37,194 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-27 00:01:37,194 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,36739,1695772857140' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-27 00:01:37,195 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,196 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,196 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:37,196 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:37,197 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:37,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:01:37,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:01:37,197 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,197 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 00:01:37,197 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,197 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 00:01:37,197 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,197 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 00:01:37,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:01:37,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:01:37,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:37,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:37,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:37,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:01:37,199 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,41703,1695772857103' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-27 00:01:37,199 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2847eee7[Count = 1] remaining members to acquire global barrier 2023-09-27 00:01:37,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:37,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:01:37,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:01:37,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:01:37,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:01:37,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:37,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:37,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:37,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:01:37,201 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,36739,1695772857140' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-27 00:01:37,201 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2847eee7[Count = 0] remaining members to acquire global barrier 2023-09-27 00:01:37,201 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-27 00:01:37,201 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,202 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,202 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,202 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,203 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-27 00:01:37,203 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-27 00:01:37,203 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,41869,1695772857056' in zk 2023-09-27 00:01:37,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,203 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-27 00:01:37,202 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:37,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,203 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-27 00:01:37,203 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 00:01:37,203 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 00:01:37,203 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695772896508.02903f28fedd146e9c2436d5eea1bef5. 2023-09-27 00:01:37,203 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 00:01:37,203 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:37,203 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 00:01:37,203 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 00:01:37,203 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695772896508.02903f28fedd146e9c2436d5eea1bef5. started... 2023-09-27 00:01:37,203 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695772896508.9cce9cd89f83fedacc0910c7826fc4ba. 2023-09-27 00:01:37,203 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695772896508.9cce9cd89f83fedacc0910c7826fc4ba. started... 2023-09-27 00:01:37,204 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 02903f28fedd146e9c2436d5eea1bef5: 2023-09-27 00:01:37,204 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9cce9cd89f83fedacc0910c7826fc4ba: 2023-09-27 00:01:37,205 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695772896508.02903f28fedd146e9c2436d5eea1bef5.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,205 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695772896508.9cce9cd89f83fedacc0910c7826fc4ba.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,205 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 00:01:37,206 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 00:01:37,206 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 00:01:37,206 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 00:01:37,211 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-27 00:01:37,211 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:01:37,211 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-27 00:01:37,216 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695772896508.9cce9cd89f83fedacc0910c7826fc4ba. completed. 2023-09-27 00:01:37,216 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695772896508.9cce9cd89f83fedacc0910c7826fc4ba. 2023-09-27 00:01:37,216 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 00:01:37,216 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 00:01:37,216 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:37,216 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695772896508.02903f28fedd146e9c2436d5eea1bef5. completed. 2023-09-27 00:01:37,216 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-27 00:01:37,216 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,41703,1695772857103' in zk 2023-09-27 00:01:37,216 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695772896508.02903f28fedd146e9c2436d5eea1bef5. 2023-09-27 00:01:37,217 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 00:01:37,217 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 00:01:37,217 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:37,217 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-27 00:01:37,217 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,36739,1695772857140' in zk 2023-09-27 00:01:37,218 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-27 00:01:37,218 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:37,218 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:01:37,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:37,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:01:37,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:01:37,218 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-27 00:01:37,219 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-27 00:01:37,219 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:37,219 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:01:37,220 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-27 00:01:37,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:01:37,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:01:37,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:37,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:37,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:37,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:01:37,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:37,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:37,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:37,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,41703,1695772857103': 2023-09-27 00:01:37,223 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,41703,1695772857103' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-27 00:01:37,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:37,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:01:37,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:01:37,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:01:37,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:01:37,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:37,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:37,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:37,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:01:37,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:37,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:37,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:37,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,36739,1695772857140': 2023-09-27 00:01:37,226 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,36739,1695772857140' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-27 00:01:37,226 INFO [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-09-27 00:01:37,227 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 00:01:37,227 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 00:01:37,227 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,227 INFO [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 00:01:37,230 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,230 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:01:37,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:01:37,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,231 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:01:37,230 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,230 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,231 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:01:37,231 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:01:37,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:01:37,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,231 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:37,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:01:37,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:01:37,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:01:37,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:01:37,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:01:37,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:01:37,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:01:37,232 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:37,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,233 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:37,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:37,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:37,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:37,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:01:37,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,234 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:37,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:37,235 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:37,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:37,235 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:37,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:37,237 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:37,238 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,238 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:01:37,238 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:37,238 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:01:37,238 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:01:37,238 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:01:37,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:01:37,238 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,238 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:01:37,238 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:37,238 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:01:37,240 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,239 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-27 00:01:37,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:01:37,240 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:01:37,239 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:01:37,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:01:37,240 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 00:01:37,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:01:37,240 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:37,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:01:37,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:01:37,240 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:01:37,240 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:37,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:01:37,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:01:37,240 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:37,241 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,241 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:01:37,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:01:37,241 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-27 00:01:37,250 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,250 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,266 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 00:01:37,266 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,267 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-27 00:01:37,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-27 00:01:37,267 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 00:01:37,268 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-27 00:01:37,268 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695772897165Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695772897250 (+85 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1695772897250Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1695772897250Writing data manifest for emptySnaptb0-testConsecutiveExports at 1695772897253 (+3 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1695772897261 (+8 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695772897267 (+6 ms) 2023-09-27 00:01:37,273 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-27 00:01:37,274 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 107 msec 2023-09-27 00:01:37,275 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41703] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1695772896508.9cce9cd89f83fedacc0910c7826fc4ba. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 00:01:37,277 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36739] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1695772896508.02903f28fedd146e9c2436d5eea1bef5. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 00:01:37,280 DEBUG [Listener at jenkins-hbase9.apache.org/45033] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-27 00:01:37,280 DEBUG [Listener at jenkins-hbase9.apache.org/45033] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695772896508.9cce9cd89f83fedacc0910c7826fc4ba. 2023-09-27 00:01:37,280 INFO [Listener at jenkins-hbase9.apache.org/45033] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 00:01:37,291 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-27 00:01:37,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695772897291 (current time:1695772897291). 2023-09-27 00:01:37,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 00:01:37,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(139): Connect 0x36eea3fb to 127.0.0.1:57983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 00:01:37,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4926033b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 00:01:37,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 00:01:37,313 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:33040, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 00:01:37,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x36eea3fb to 127.0.0.1:57983 2023-09-27 00:01:37,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 00:01:37,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(139): Connect 0x3ef982e5 to 127.0.0.1:57983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 00:01:37,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d4b0fba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 00:01:37,331 DEBUG [hconnection-0x40de4f3-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 00:01:37,332 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:33042, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 00:01:37,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ef982e5 to 127.0.0.1:57983 2023-09-27 00:01:37,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 00:01:37,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-27 00:01:37,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 00:01:37,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-27 00:01:37,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-27 00:01:37,342 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-27 00:01:37,342 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695773497342 2023-09-27 00:01:37,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-27 00:01:37,343 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-27 00:01:37,344 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 00:01:37,344 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 00:01:37,345 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-27 00:01:37,345 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-27 00:01:37,348 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-09-27 00:01:37,349 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-27 00:01:37,350 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695773497350 2023-09-27 00:01:37,367 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-09-27 00:01:37,367 INFO [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-09-27 00:01:37,367 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:01:37,369 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-09-27 00:01:37,369 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-27 00:01:37,369 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,369 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,377 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:37,377 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:01:37,377 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:01:37,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:01:37,377 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:01:37,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:01:37,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:01:37,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:01:37,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:01:37,378 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:37,378 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:37,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,378 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:37,378 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 00:01:37,378 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,379 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-27 00:01:37,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-27 00:01:37,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,379 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-27 00:01:37,379 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-27 00:01:37,380 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-27 00:01:37,380 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:01:37,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:01:37,381 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-27 00:01:37,381 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-27 00:01:37,379 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-27 00:01:37,381 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,36739,1695772857140' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-27 00:01:37,381 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-27 00:01:37,382 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-27 00:01:37,382 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:01:37,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,383 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-27 00:01:37,383 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-27 00:01:37,383 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41703,1695772857103' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-27 00:01:37,391 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,391 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:37,392 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:37,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:01:37,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:01:37,392 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,392 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 00:01:37,401 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:01:37,401 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:37,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-27 00:01:37,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:01:37,401 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,401 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 00:01:37,401 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-27 00:01:37,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-27 00:01:37,402 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-27 00:01:37,402 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-27 00:01:37,402 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:01:37,403 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-27 00:01:37,403 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-27 00:01:37,403 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41869,1695772857056' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-27 00:01:37,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:37,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:37,413 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:01:37,413 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,413 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,36739,1695772857140' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-27 00:01:37,413 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 00:01:37,413 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a519ef6[Count = 1] remaining members to acquire global barrier 2023-09-27 00:01:37,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:37,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:01:37,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:01:37,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:01:37,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:01:37,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-27 00:01:37,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:37,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:37,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:37,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:01:37,415 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,41703,1695772857103' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-27 00:01:37,415 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a519ef6[Count = 0] remaining members to acquire global barrier 2023-09-27 00:01:37,415 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-27 00:01:37,415 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,425 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,425 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,425 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,425 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-27 00:01:37,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,425 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:37,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,425 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 00:01:37,426 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 00:01:37,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,426 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695772896508.02903f28fedd146e9c2436d5eea1bef5. 2023-09-27 00:01:37,426 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-27 00:01:37,426 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695772896508.02903f28fedd146e9c2436d5eea1bef5. started... 2023-09-27 00:01:37,425 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-27 00:01:37,426 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-27 00:01:37,426 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 00:01:37,426 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,41869,1695772857056' in zk 2023-09-27 00:01:37,426 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695772896508.9cce9cd89f83fedacc0910c7826fc4ba. 2023-09-27 00:01:37,426 INFO [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 02903f28fedd146e9c2436d5eea1bef5 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-27 00:01:37,426 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695772896508.9cce9cd89f83fedacc0910c7826fc4ba. started... 2023-09-27 00:01:37,426 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:37,426 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 00:01:37,426 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 00:01:37,426 INFO [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9cce9cd89f83fedacc0910c7826fc4ba 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-27 00:01:37,436 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-27 00:01:37,436 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:01:37,436 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-27 00:01:37,444 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 00:01:37,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-27 00:01:37,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-27 00:01:37,446 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 00:01:37,457 INFO [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230927f2f8fde4847d4362811c9c76898c0901 to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230927f2f8fde4847d4362811c9c76898c0901 2023-09-27 00:01:37,460 INFO [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230927da8b267ac2ed49129d9f6469ab9f4348 to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230927da8b267ac2ed49129d9f6469ab9f4348 2023-09-27 00:01:37,472 INFO [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testConsecutiveExports/9cce9cd89f83fedacc0910c7826fc4ba/.tmp/cf/ed472780753b446882a419a644e36a3e 2023-09-27 00:01:37,476 INFO [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testConsecutiveExports/02903f28fedd146e9c2436d5eea1bef5/.tmp/cf/d9bf9c2784e140d8aaa57edf9d251ae8 2023-09-27 00:01:37,479 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testConsecutiveExports/9cce9cd89f83fedacc0910c7826fc4ba/.tmp/cf/ed472780753b446882a419a644e36a3e as hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testConsecutiveExports/9cce9cd89f83fedacc0910c7826fc4ba/cf/ed472780753b446882a419a644e36a3e 2023-09-27 00:01:37,482 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testConsecutiveExports/02903f28fedd146e9c2436d5eea1bef5/.tmp/cf/d9bf9c2784e140d8aaa57edf9d251ae8 as hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testConsecutiveExports/02903f28fedd146e9c2436d5eea1bef5/cf/d9bf9c2784e140d8aaa57edf9d251ae8 2023-09-27 00:01:37,485 INFO [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testConsecutiveExports/9cce9cd89f83fedacc0910c7826fc4ba/cf/ed472780753b446882a419a644e36a3e, entries=4, sequenceid=6, filesize=5.6 K 2023-09-27 00:01:37,486 INFO [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 9cce9cd89f83fedacc0910c7826fc4ba in 60ms, sequenceid=6, compaction requested=false 2023-09-27 00:01:37,486 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-27 00:01:37,486 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9cce9cd89f83fedacc0910c7826fc4ba: 2023-09-27 00:01:37,487 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695772896508.9cce9cd89f83fedacc0910c7826fc4ba.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-27 00:01:37,487 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 00:01:37,487 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testConsecutiveExports/9cce9cd89f83fedacc0910c7826fc4ba/cf/ed472780753b446882a419a644e36a3e] hfiles 2023-09-27 00:01:37,487 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testConsecutiveExports/9cce9cd89f83fedacc0910c7826fc4ba/cf/ed472780753b446882a419a644e36a3e for snapshot=snaptb0-testConsecutiveExports 2023-09-27 00:01:37,487 INFO [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testConsecutiveExports/02903f28fedd146e9c2436d5eea1bef5/cf/d9bf9c2784e140d8aaa57edf9d251ae8, entries=46, sequenceid=6, filesize=12.5 K 2023-09-27 00:01:37,488 INFO [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 02903f28fedd146e9c2436d5eea1bef5 in 62ms, sequenceid=6, compaction requested=false 2023-09-27 00:01:37,490 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 02903f28fedd146e9c2436d5eea1bef5: 2023-09-27 00:01:37,491 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695772896508.02903f28fedd146e9c2436d5eea1bef5.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-27 00:01:37,491 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 00:01:37,491 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testConsecutiveExports/02903f28fedd146e9c2436d5eea1bef5/cf/d9bf9c2784e140d8aaa57edf9d251ae8] hfiles 2023-09-27 00:01:37,491 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testConsecutiveExports/02903f28fedd146e9c2436d5eea1bef5/cf/d9bf9c2784e140d8aaa57edf9d251ae8 for snapshot=snaptb0-testConsecutiveExports 2023-09-27 00:01:37,504 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695772896508.9cce9cd89f83fedacc0910c7826fc4ba. completed. 2023-09-27 00:01:37,504 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695772896508.9cce9cd89f83fedacc0910c7826fc4ba. 2023-09-27 00:01:37,504 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 00:01:37,504 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 00:01:37,504 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:37,505 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-27 00:01:37,505 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,41703,1695772857103' in zk 2023-09-27 00:01:37,507 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:37,507 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-27 00:01:37,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:37,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:01:37,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:01:37,507 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:01:37,507 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695772896508.02903f28fedd146e9c2436d5eea1bef5. completed. 2023-09-27 00:01:37,507 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-27 00:01:37,509 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695772896508.02903f28fedd146e9c2436d5eea1bef5. 2023-09-27 00:01:37,509 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 00:01:37,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:01:37,509 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 00:01:37,509 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:37,509 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-27 00:01:37,509 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,36739,1695772857140' in zk 2023-09-27 00:01:37,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:01:37,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-27 00:01:37,511 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:37,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:37,511 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-27 00:01:37,511 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:01:37,511 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-27 00:01:37,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:37,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:37,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:01:37,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-27 00:01:37,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:37,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:37,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:37,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,41703,1695772857103': 2023-09-27 00:01:37,515 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,41703,1695772857103' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-27 00:01:37,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:37,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:01:37,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:01:37,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:01:37,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:01:37,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-27 00:01:37,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:37,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:37,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:37,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:01:37,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-27 00:01:37,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:37,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:37,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:37,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,36739,1695772857140': 2023-09-27 00:01:37,518 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,36739,1695772857140' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-27 00:01:37,518 INFO [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-09-27 00:01:37,518 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 00:01:37,518 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 00:01:37,518 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-09-27 00:01:37,518 INFO [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 00:01:37,520 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,520 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:01:37,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:01:37,520 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,520 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,520 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:01:37,521 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:01:37,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,521 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:01:37,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:01:37,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:01:37,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:01:37,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:01:37,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:01:37,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:01:37,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:01:37,522 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:37,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-27 00:01:37,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,522 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:37,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:01:37,523 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:37,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-27 00:01:37,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:37,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:37,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:37,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:01:37,524 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:37,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-27 00:01:37,525 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:37,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:37,525 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:37,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:37,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:37,532 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:01:37,532 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:01:37,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:01:37,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:01:37,533 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-09-27 00:01:37,533 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:37,533 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:01:37,533 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:01:37,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:01:37,533 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-27 00:01:37,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:01:37,533 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:01:37,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:01:37,532 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:01:37,532 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:01:37,533 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-27 00:01:37,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:01:37,535 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 00:01:37,533 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:37,533 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:01:37,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:01:37,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:01:37,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:01:37,535 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:37,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:01:37,535 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:01:37,535 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:01:37,536 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,536 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:01:37,536 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:01:37,536 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,536 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,536 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230927da8b267ac2ed49129d9f6469ab9f4348, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230927f2f8fde4847d4362811c9c76898c0901] mob files 2023-09-27 00:01:37,536 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230927da8b267ac2ed49129d9f6469ab9f4348 2023-09-27 00:01:37,536 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230927f2f8fde4847d4362811c9c76898c0901 2023-09-27 00:01:37,547 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-09-27 00:01:37,548 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,572 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,573 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-27 00:01:37,573 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,573 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,573 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695772897343Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695772897547 (+204 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1695772897547Loading Region manifests for snaptb0-testConsecutiveExports at 1695772897547Writing data manifest for snaptb0-testConsecutiveExports at 1695772897551 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1695772897565 (+14 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695772897573 (+8 ms) 2023-09-27 00:01:37,576 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-27 00:01:37,577 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 232 msec 2023-09-27 00:01:37,646 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 00:01:37,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-27 00:01:37,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 00:01:37,647 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/local-export-1695772897647 2023-09-27 00:01:37,647 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/local-export-1695772897647, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/local-export-1695772897647, srcFsUri=hdfs://localhost:40313, srcDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8 2023-09-27 00:01:37,668 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40313, inputRoot=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8 2023-09-27 00:01:37,668 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@2a229683, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/local-export-1695772897647, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/local-export-1695772897647/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,668 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40313, inputRoot=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8, snapshotDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-27 00:01:37,676 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/local-export-1695772897647/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-27 00:01:37,687 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-27 00:01:37,688 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-27 00:01:37,688 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-27 00:01:37,689 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-27 00:01:38,543 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/hadoop-5537492795783588406.jar 2023-09-27 00:01:38,543 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-27 00:01:38,543 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-27 00:01:38,609 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/hadoop-1698413287446703719.jar 2023-09-27 00:01:38,609 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-27 00:01:38,609 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-27 00:01:38,610 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-27 00:01:38,610 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-27 00:01:38,611 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-27 00:01:38,611 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-27 00:01:38,612 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-27 00:01:38,612 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-27 00:01:38,612 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-27 00:01:38,613 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-27 00:01:38,613 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-27 00:01:38,614 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-27 00:01:38,614 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-27 00:01:38,614 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-27 00:01:38,614 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-27 00:01:38,615 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-27 00:01:38,616 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 00:01:38,616 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 00:01:38,617 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 00:01:38,617 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 00:01:38,617 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 00:01:38,617 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 00:01:38,618 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 00:01:38,975 WARN [Listener at jenkins-hbase9.apache.org/45033] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-27 00:01:38,977 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-27 00:01:38,979 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-27 00:01:40,247 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 00:01:40,247 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 00:01:40,249 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695772863328_0002_000001 (auth:SIMPLE) 2023-09-27 00:01:40,622 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695772863328_0003_000001 (auth:SIMPLE) 2023-09-27 00:01:41,795 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-27 00:01:44,287 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695772863328_0003_000001 (auth:SIMPLE) 2023-09-27 00:01:46,502 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695772863328_0003_000001 (auth:SIMPLE) 2023-09-27 00:01:48,944 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695772863328_0003_000001 (auth:SIMPLE) 2023-09-27 00:01:50,128 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-27 00:01:50,128 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-27 00:01:50,132 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-27 00:01:50,133 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-27 00:01:50,133 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-27 00:01:50,133 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-728144799_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-27 00:01:50,136 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(367): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-27 00:01:50,136 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(367): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-27 00:01:50,136 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@53b38a75 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/local-export-1695772897647/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/local-export-1695772897647/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-27 00:01:50,137 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/local-export-1695772897647/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-27 00:01:50,137 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/local-export-1695772897647/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-27 00:01:50,138 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/local-export-1695772897647, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/local-export-1695772897647, srcFsUri=hdfs://localhost:40313, srcDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8 2023-09-27 00:01:50,161 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40313, inputRoot=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8 2023-09-27 00:01:50,161 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@49e9b867, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/local-export-1695772897647, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/local-export-1695772897647/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-27 00:01:50,161 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40313, inputRoot=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8, snapshotDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-27 00:01:50,174 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/local-export-1695772897647/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-27 00:01:50,186 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-27 00:01:50,187 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-27 00:01:50,187 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-27 00:01:50,187 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-27 00:01:51,034 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/hadoop-1798104546196600523.jar 2023-09-27 00:01:51,035 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-27 00:01:51,035 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-27 00:01:51,099 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/hadoop-2027258232386902221.jar 2023-09-27 00:01:51,100 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-27 00:01:51,100 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-27 00:01:51,101 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-27 00:01:51,101 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-27 00:01:51,101 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-27 00:01:51,102 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-27 00:01:51,102 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-27 00:01:51,102 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-27 00:01:51,103 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-27 00:01:51,103 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-27 00:01:51,103 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-27 00:01:51,104 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-27 00:01:51,104 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-27 00:01:51,105 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-27 00:01:51,105 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-27 00:01:51,106 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-27 00:01:51,106 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 00:01:51,106 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 00:01:51,107 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 00:01:51,107 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 00:01:51,107 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 00:01:51,108 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 00:01:51,108 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 00:01:51,449 WARN [Listener at jenkins-hbase9.apache.org/45033] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-27 00:01:51,451 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-27 00:01:51,453 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-27 00:01:55,114 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 00:01:55,114 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 00:01:55,117 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695772863328_0003_000001 (auth:SIMPLE) 2023-09-27 00:01:55,265 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695772863328_0004_000001 (auth:SIMPLE) 2023-09-27 00:01:58,955 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695772863328_0004_000001 (auth:SIMPLE) 2023-09-27 00:02:01,164 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695772863328_0004_000001 (auth:SIMPLE) 2023-09-27 00:02:03,906 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695772863328_0004_000001 (auth:SIMPLE) 2023-09-27 00:02:05,641 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-27 00:02:05,641 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-27 00:02:05,644 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-27 00:02:05,644 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-27 00:02:05,644 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-27 00:02:05,645 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-728144799_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-27 00:02:05,647 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(367): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-27 00:02:05,647 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(367): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-27 00:02:05,648 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@53b38a75 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/local-export-1695772897647/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/local-export-1695772897647/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-27 00:02:05,648 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/local-export-1695772897647/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-27 00:02:05,648 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/local-export-1695772897647/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-27 00:02:05,660 INFO [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-09-27 00:02:05,661 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testConsecutiveExports 2023-09-27 00:02:05,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-09-27 00:02:05,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-27 00:02:05,666 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695772925666"}]},"ts":"1695772925666"} 2023-09-27 00:02:05,667 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-09-27 00:02:05,669 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-09-27 00:02:05,670 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9cce9cd89f83fedacc0910c7826fc4ba, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=02903f28fedd146e9c2436d5eea1bef5, UNASSIGN}] 2023-09-27 00:02:05,673 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9cce9cd89f83fedacc0910c7826fc4ba, UNASSIGN 2023-09-27 00:02:05,673 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=02903f28fedd146e9c2436d5eea1bef5, UNASSIGN 2023-09-27 00:02:05,673 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=9cce9cd89f83fedacc0910c7826fc4ba, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:05,674 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=02903f28fedd146e9c2436d5eea1bef5, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:05,674 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695772896508.9cce9cd89f83fedacc0910c7826fc4ba.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695772925673"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695772925673"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695772925673"}]},"ts":"1695772925673"} 2023-09-27 00:02:05,674 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695772896508.02903f28fedd146e9c2436d5eea1bef5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695772925674"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695772925674"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695772925674"}]},"ts":"1695772925674"} 2023-09-27 00:02:05,675 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 02903f28fedd146e9c2436d5eea1bef5, server=jenkins-hbase9.apache.org,36739,1695772857140}] 2023-09-27 00:02:05,676 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 9cce9cd89f83fedacc0910c7826fc4ba, server=jenkins-hbase9.apache.org,41703,1695772857103}] 2023-09-27 00:02:05,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-27 00:02:05,828 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 02903f28fedd146e9c2436d5eea1bef5 2023-09-27 00:02:05,828 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 02903f28fedd146e9c2436d5eea1bef5, disabling compactions & flushes 2023-09-27 00:02:05,828 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695772896508.02903f28fedd146e9c2436d5eea1bef5. 2023-09-27 00:02:05,828 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695772896508.02903f28fedd146e9c2436d5eea1bef5. 2023-09-27 00:02:05,828 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695772896508.02903f28fedd146e9c2436d5eea1bef5. after waiting 0 ms 2023-09-27 00:02:05,828 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695772896508.02903f28fedd146e9c2436d5eea1bef5. 2023-09-27 00:02:05,830 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 9cce9cd89f83fedacc0910c7826fc4ba 2023-09-27 00:02:05,832 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 9cce9cd89f83fedacc0910c7826fc4ba, disabling compactions & flushes 2023-09-27 00:02:05,832 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695772896508.9cce9cd89f83fedacc0910c7826fc4ba. 2023-09-27 00:02:05,832 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695772896508.9cce9cd89f83fedacc0910c7826fc4ba. 2023-09-27 00:02:05,832 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695772896508.9cce9cd89f83fedacc0910c7826fc4ba. after waiting 0 ms 2023-09-27 00:02:05,832 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695772896508.9cce9cd89f83fedacc0910c7826fc4ba. 2023-09-27 00:02:05,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testConsecutiveExports/02903f28fedd146e9c2436d5eea1bef5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 00:02:05,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testConsecutiveExports/9cce9cd89f83fedacc0910c7826fc4ba/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 00:02:05,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 00:02:05,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 00:02:05,847 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695772896508.9cce9cd89f83fedacc0910c7826fc4ba. 2023-09-27 00:02:05,847 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695772896508.02903f28fedd146e9c2436d5eea1bef5. 2023-09-27 00:02:05,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 9cce9cd89f83fedacc0910c7826fc4ba: 2023-09-27 00:02:05,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 02903f28fedd146e9c2436d5eea1bef5: 2023-09-27 00:02:05,849 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 9cce9cd89f83fedacc0910c7826fc4ba 2023-09-27 00:02:05,850 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=9cce9cd89f83fedacc0910c7826fc4ba, regionState=CLOSED 2023-09-27 00:02:05,850 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695772896508.9cce9cd89f83fedacc0910c7826fc4ba.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695772925850"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695772925850"}]},"ts":"1695772925850"} 2023-09-27 00:02:05,850 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 02903f28fedd146e9c2436d5eea1bef5 2023-09-27 00:02:05,850 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=02903f28fedd146e9c2436d5eea1bef5, regionState=CLOSED 2023-09-27 00:02:05,850 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695772896508.02903f28fedd146e9c2436d5eea1bef5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695772925850"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695772925850"}]},"ts":"1695772925850"} 2023-09-27 00:02:05,853 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=52 2023-09-27 00:02:05,853 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 9cce9cd89f83fedacc0910c7826fc4ba, server=jenkins-hbase9.apache.org,41703,1695772857103 in 175 msec 2023-09-27 00:02:05,854 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=53 2023-09-27 00:02:05,854 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 02903f28fedd146e9c2436d5eea1bef5, server=jenkins-hbase9.apache.org,36739,1695772857140 in 177 msec 2023-09-27 00:02:05,855 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9cce9cd89f83fedacc0910c7826fc4ba, UNASSIGN in 183 msec 2023-09-27 00:02:05,856 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-09-27 00:02:05,856 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=02903f28fedd146e9c2436d5eea1bef5, UNASSIGN in 184 msec 2023-09-27 00:02:05,857 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695772925857"}]},"ts":"1695772925857"} 2023-09-27 00:02:05,858 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-09-27 00:02:05,861 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-09-27 00:02:05,862 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 200 msec 2023-09-27 00:02:05,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-27 00:02:05,968 INFO [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-09-27 00:02:05,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testConsecutiveExports 2023-09-27 00:02:05,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-27 00:02:05,972 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-27 00:02:05,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-09-27 00:02:05,973 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-27 00:02:05,976 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41869] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-09-27 00:02:05,979 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-27 00:02:05,979 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-27 00:02:05,979 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-27 00:02:05,979 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-27 00:02:05,980 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-27 00:02:05,980 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-27 00:02:05,980 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-27 00:02:05,981 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testConsecutiveExports/9cce9cd89f83fedacc0910c7826fc4ba 2023-09-27 00:02:05,981 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testConsecutiveExports/02903f28fedd146e9c2436d5eea1bef5 2023-09-27 00:02:05,981 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-27 00:02:05,981 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-27 00:02:05,981 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:02:05,981 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-09-27 00:02:05,981 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:02:05,982 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-27 00:02:05,981 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-27 00:02:05,982 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:02:05,981 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:02:05,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-27 00:02:05,983 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testConsecutiveExports/9cce9cd89f83fedacc0910c7826fc4ba/cf, FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testConsecutiveExports/9cce9cd89f83fedacc0910c7826fc4ba/recovered.edits] 2023-09-27 00:02:05,983 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testConsecutiveExports/02903f28fedd146e9c2436d5eea1bef5/cf, FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testConsecutiveExports/02903f28fedd146e9c2436d5eea1bef5/recovered.edits] 2023-09-27 00:02:05,988 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testConsecutiveExports/9cce9cd89f83fedacc0910c7826fc4ba/cf/ed472780753b446882a419a644e36a3e to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/archive/data/default/testtb-testConsecutiveExports/9cce9cd89f83fedacc0910c7826fc4ba/cf/ed472780753b446882a419a644e36a3e 2023-09-27 00:02:05,988 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testConsecutiveExports/02903f28fedd146e9c2436d5eea1bef5/cf/d9bf9c2784e140d8aaa57edf9d251ae8 to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/archive/data/default/testtb-testConsecutiveExports/02903f28fedd146e9c2436d5eea1bef5/cf/d9bf9c2784e140d8aaa57edf9d251ae8 2023-09-27 00:02:05,991 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testConsecutiveExports/9cce9cd89f83fedacc0910c7826fc4ba/recovered.edits/9.seqid to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/archive/data/default/testtb-testConsecutiveExports/9cce9cd89f83fedacc0910c7826fc4ba/recovered.edits/9.seqid 2023-09-27 00:02:05,991 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testConsecutiveExports/02903f28fedd146e9c2436d5eea1bef5/recovered.edits/9.seqid to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/archive/data/default/testtb-testConsecutiveExports/02903f28fedd146e9c2436d5eea1bef5/recovered.edits/9.seqid 2023-09-27 00:02:05,992 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testConsecutiveExports/9cce9cd89f83fedacc0910c7826fc4ba 2023-09-27 00:02:05,992 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testConsecutiveExports/02903f28fedd146e9c2436d5eea1bef5 2023-09-27 00:02:05,992 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-27 00:02:05,993 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-27 00:02:05,993 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-09-27 00:02:05,996 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230927da8b267ac2ed49129d9f6469ab9f4348 to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230927da8b267ac2ed49129d9f6469ab9f4348 2023-09-27 00:02:05,998 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230927f2f8fde4847d4362811c9c76898c0901 to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230927f2f8fde4847d4362811c9c76898c0901 2023-09-27 00:02:05,998 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-27 00:02:06,000 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-27 00:02:06,003 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-09-27 00:02:06,005 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-09-27 00:02:06,006 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-27 00:02:06,006 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-09-27 00:02:06,006 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1695772896508.9cce9cd89f83fedacc0910c7826fc4ba.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695772926006"}]},"ts":"9223372036854775807"} 2023-09-27 00:02:06,006 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1695772896508.02903f28fedd146e9c2436d5eea1bef5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695772926006"}]},"ts":"9223372036854775807"} 2023-09-27 00:02:06,008 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-27 00:02:06,008 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9cce9cd89f83fedacc0910c7826fc4ba, NAME => 'testtb-testConsecutiveExports,,1695772896508.9cce9cd89f83fedacc0910c7826fc4ba.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 02903f28fedd146e9c2436d5eea1bef5, NAME => 'testtb-testConsecutiveExports,1,1695772896508.02903f28fedd146e9c2436d5eea1bef5.', STARTKEY => '1', ENDKEY => ''}] 2023-09-27 00:02:06,008 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-09-27 00:02:06,008 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695772926008"}]},"ts":"9223372036854775807"} 2023-09-27 00:02:06,010 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-09-27 00:02:06,012 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-27 00:02:06,014 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 44 msec 2023-09-27 00:02:06,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-27 00:02:06,084 INFO [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-09-27 00:02:06,094 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testConsecutiveExports" 2023-09-27 00:02:06,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-09-27 00:02:06,098 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testConsecutiveExports" 2023-09-27 00:02:06,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-09-27 00:02:06,123 INFO [Listener at jenkins-hbase9.apache.org/45033] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=750 (was 764), OpenFileDescriptor=909 (was 926), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=220 (was 259), ProcessCount=168 (was 168), AvailableMemoryMB=6580 (was 6747) 2023-09-27 00:02:06,123 WARN [Listener at jenkins-hbase9.apache.org/45033] hbase.ResourceChecker(130): Thread=750 is superior to 500 2023-09-27 00:02:06,141 INFO [Listener at jenkins-hbase9.apache.org/45033] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=750, OpenFileDescriptor=909, MaxFileDescriptor=60000, SystemLoadAverage=220, ProcessCount=168, AvailableMemoryMB=6579 2023-09-27 00:02:06,141 WARN [Listener at jenkins-hbase9.apache.org/45033] hbase.ResourceChecker(130): Thread=750 is superior to 500 2023-09-27 00:02:06,143 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-27 00:02:06,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,146 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-09-27 00:02:06,147 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-09-27 00:02:06,147 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-27 00:02:06,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-27 00:02:06,150 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e80833319d87b98c277e134031aa5fb1 2023-09-27 00:02:06,150 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/37b68fc7a2afce55fcfb8fbe7bcd057f 2023-09-27 00:02:06,150 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e80833319d87b98c277e134031aa5fb1 empty. 2023-09-27 00:02:06,150 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/37b68fc7a2afce55fcfb8fbe7bcd057f empty. 2023-09-27 00:02:06,151 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e80833319d87b98c277e134031aa5fb1 2023-09-27 00:02:06,151 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/37b68fc7a2afce55fcfb8fbe7bcd057f 2023-09-27 00:02:06,151 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-27 00:02:06,167 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-09-27 00:02:06,169 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 37b68fc7a2afce55fcfb8fbe7bcd057f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695772926143.37b68fc7a2afce55fcfb8fbe7bcd057f.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp 2023-09-27 00:02:06,169 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => e80833319d87b98c277e134031aa5fb1, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695772926143.e80833319d87b98c277e134031aa5fb1.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp 2023-09-27 00:02:06,189 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695772926143.e80833319d87b98c277e134031aa5fb1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 00:02:06,189 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695772926143.37b68fc7a2afce55fcfb8fbe7bcd057f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 00:02:06,190 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing e80833319d87b98c277e134031aa5fb1, disabling compactions & flushes 2023-09-27 00:02:06,190 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 37b68fc7a2afce55fcfb8fbe7bcd057f, disabling compactions & flushes 2023-09-27 00:02:06,190 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695772926143.e80833319d87b98c277e134031aa5fb1. 2023-09-27 00:02:06,190 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695772926143.e80833319d87b98c277e134031aa5fb1. 2023-09-27 00:02:06,190 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695772926143.37b68fc7a2afce55fcfb8fbe7bcd057f. 2023-09-27 00:02:06,190 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695772926143.e80833319d87b98c277e134031aa5fb1. after waiting 0 ms 2023-09-27 00:02:06,190 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695772926143.e80833319d87b98c277e134031aa5fb1. 2023-09-27 00:02:06,190 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695772926143.37b68fc7a2afce55fcfb8fbe7bcd057f. 2023-09-27 00:02:06,190 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695772926143.e80833319d87b98c277e134031aa5fb1. 2023-09-27 00:02:06,190 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695772926143.37b68fc7a2afce55fcfb8fbe7bcd057f. after waiting 0 ms 2023-09-27 00:02:06,190 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for e80833319d87b98c277e134031aa5fb1: 2023-09-27 00:02:06,190 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695772926143.37b68fc7a2afce55fcfb8fbe7bcd057f. 2023-09-27 00:02:06,190 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695772926143.37b68fc7a2afce55fcfb8fbe7bcd057f. 2023-09-27 00:02:06,190 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 37b68fc7a2afce55fcfb8fbe7bcd057f: 2023-09-27 00:02:06,194 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-09-27 00:02:06,195 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695772926143.e80833319d87b98c277e134031aa5fb1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695772926195"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695772926195"}]},"ts":"1695772926195"} 2023-09-27 00:02:06,195 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695772926143.37b68fc7a2afce55fcfb8fbe7bcd057f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695772926195"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695772926195"}]},"ts":"1695772926195"} 2023-09-27 00:02:06,201 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-27 00:02:06,202 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-27 00:02:06,203 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695772926203"}]},"ts":"1695772926203"} 2023-09-27 00:02:06,204 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-09-27 00:02:06,208 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-09-27 00:02:06,209 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 00:02:06,209 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 00:02:06,209 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 00:02:06,210 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 00:02:06,210 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e80833319d87b98c277e134031aa5fb1, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=37b68fc7a2afce55fcfb8fbe7bcd057f, ASSIGN}] 2023-09-27 00:02:06,213 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=37b68fc7a2afce55fcfb8fbe7bcd057f, ASSIGN 2023-09-27 00:02:06,213 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e80833319d87b98c277e134031aa5fb1, ASSIGN 2023-09-27 00:02:06,214 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=37b68fc7a2afce55fcfb8fbe7bcd057f, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,36739,1695772857140; forceNewPlan=false, retain=false 2023-09-27 00:02:06,214 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e80833319d87b98c277e134031aa5fb1, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,41869,1695772857056; forceNewPlan=false, retain=false 2023-09-27 00:02:06,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-27 00:02:06,364 INFO [jenkins-hbase9:33541] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-27 00:02:06,367 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=37b68fc7a2afce55fcfb8fbe7bcd057f, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:06,367 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=e80833319d87b98c277e134031aa5fb1, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:06,368 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695772926143.37b68fc7a2afce55fcfb8fbe7bcd057f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695772926367"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695772926367"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695772926367"}]},"ts":"1695772926367"} 2023-09-27 00:02:06,368 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695772926143.e80833319d87b98c277e134031aa5fb1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695772926367"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695772926367"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695772926367"}]},"ts":"1695772926367"} 2023-09-27 00:02:06,370 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 37b68fc7a2afce55fcfb8fbe7bcd057f, server=jenkins-hbase9.apache.org,36739,1695772857140}] 2023-09-27 00:02:06,370 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure e80833319d87b98c277e134031aa5fb1, server=jenkins-hbase9.apache.org,41869,1695772857056}] 2023-09-27 00:02:06,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-27 00:02:06,531 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1695772926143.37b68fc7a2afce55fcfb8fbe7bcd057f. 2023-09-27 00:02:06,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 37b68fc7a2afce55fcfb8fbe7bcd057f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695772926143.37b68fc7a2afce55fcfb8fbe7bcd057f.', STARTKEY => '1', ENDKEY => ''} 2023-09-27 00:02:06,531 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1695772926143.e80833319d87b98c277e134031aa5fb1. 2023-09-27 00:02:06,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e80833319d87b98c277e134031aa5fb1, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695772926143.e80833319d87b98c277e134031aa5fb1.', STARTKEY => '', ENDKEY => '1'} 2023-09-27 00:02:06,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1695772926143.e80833319d87b98c277e134031aa5fb1. service=AccessControlService 2023-09-27 00:02:06,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1695772926143.37b68fc7a2afce55fcfb8fbe7bcd057f. service=AccessControlService 2023-09-27 00:02:06,531 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 00:02:06,531 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 00:02:06,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion e80833319d87b98c277e134031aa5fb1 2023-09-27 00:02:06,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 37b68fc7a2afce55fcfb8fbe7bcd057f 2023-09-27 00:02:06,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695772926143.e80833319d87b98c277e134031aa5fb1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 00:02:06,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695772926143.37b68fc7a2afce55fcfb8fbe7bcd057f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 00:02:06,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for e80833319d87b98c277e134031aa5fb1 2023-09-27 00:02:06,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 37b68fc7a2afce55fcfb8fbe7bcd057f 2023-09-27 00:02:06,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for e80833319d87b98c277e134031aa5fb1 2023-09-27 00:02:06,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 37b68fc7a2afce55fcfb8fbe7bcd057f 2023-09-27 00:02:06,533 INFO [StoreOpener-e80833319d87b98c277e134031aa5fb1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e80833319d87b98c277e134031aa5fb1 2023-09-27 00:02:06,533 INFO [StoreOpener-37b68fc7a2afce55fcfb8fbe7bcd057f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 37b68fc7a2afce55fcfb8fbe7bcd057f 2023-09-27 00:02:06,535 DEBUG [StoreOpener-37b68fc7a2afce55fcfb8fbe7bcd057f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion/37b68fc7a2afce55fcfb8fbe7bcd057f/cf 2023-09-27 00:02:06,535 DEBUG [StoreOpener-37b68fc7a2afce55fcfb8fbe7bcd057f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion/37b68fc7a2afce55fcfb8fbe7bcd057f/cf 2023-09-27 00:02:06,535 DEBUG [StoreOpener-e80833319d87b98c277e134031aa5fb1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion/e80833319d87b98c277e134031aa5fb1/cf 2023-09-27 00:02:06,535 DEBUG [StoreOpener-e80833319d87b98c277e134031aa5fb1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion/e80833319d87b98c277e134031aa5fb1/cf 2023-09-27 00:02:06,536 INFO [StoreOpener-37b68fc7a2afce55fcfb8fbe7bcd057f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 37b68fc7a2afce55fcfb8fbe7bcd057f columnFamilyName cf 2023-09-27 00:02:06,536 INFO [StoreOpener-e80833319d87b98c277e134031aa5fb1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e80833319d87b98c277e134031aa5fb1 columnFamilyName cf 2023-09-27 00:02:06,538 INFO [StoreOpener-e80833319d87b98c277e134031aa5fb1-1] regionserver.HStore(310): Store=e80833319d87b98c277e134031aa5fb1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 00:02:06,538 INFO [StoreOpener-37b68fc7a2afce55fcfb8fbe7bcd057f-1] regionserver.HStore(310): Store=37b68fc7a2afce55fcfb8fbe7bcd057f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 00:02:06,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion/37b68fc7a2afce55fcfb8fbe7bcd057f 2023-09-27 00:02:06,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion/e80833319d87b98c277e134031aa5fb1 2023-09-27 00:02:06,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion/37b68fc7a2afce55fcfb8fbe7bcd057f 2023-09-27 00:02:06,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion/e80833319d87b98c277e134031aa5fb1 2023-09-27 00:02:06,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for e80833319d87b98c277e134031aa5fb1 2023-09-27 00:02:06,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 37b68fc7a2afce55fcfb8fbe7bcd057f 2023-09-27 00:02:06,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion/e80833319d87b98c277e134031aa5fb1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 00:02:06,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion/37b68fc7a2afce55fcfb8fbe7bcd057f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 00:02:06,545 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened e80833319d87b98c277e134031aa5fb1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74786660, jitterRate=0.11440807580947876}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 00:02:06,545 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 37b68fc7a2afce55fcfb8fbe7bcd057f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70645969, jitterRate=0.052706971764564514}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 00:02:06,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for e80833319d87b98c277e134031aa5fb1: 2023-09-27 00:02:06,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 37b68fc7a2afce55fcfb8fbe7bcd057f: 2023-09-27 00:02:06,546 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1695772926143.37b68fc7a2afce55fcfb8fbe7bcd057f., pid=60, masterSystemTime=1695772926521 2023-09-27 00:02:06,546 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1695772926143.e80833319d87b98c277e134031aa5fb1., pid=61, masterSystemTime=1695772926526 2023-09-27 00:02:06,548 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1695772926143.e80833319d87b98c277e134031aa5fb1. 2023-09-27 00:02:06,548 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1695772926143.e80833319d87b98c277e134031aa5fb1. 2023-09-27 00:02:06,548 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=e80833319d87b98c277e134031aa5fb1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:06,549 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695772926143.e80833319d87b98c277e134031aa5fb1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695772926548"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695772926548"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695772926548"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695772926548"}]},"ts":"1695772926548"} 2023-09-27 00:02:06,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1695772926143.37b68fc7a2afce55fcfb8fbe7bcd057f. 2023-09-27 00:02:06,549 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1695772926143.37b68fc7a2afce55fcfb8fbe7bcd057f. 2023-09-27 00:02:06,549 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=37b68fc7a2afce55fcfb8fbe7bcd057f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:06,549 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695772926143.37b68fc7a2afce55fcfb8fbe7bcd057f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695772926549"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695772926549"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695772926549"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695772926549"}]},"ts":"1695772926549"} 2023-09-27 00:02:06,552 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=58 2023-09-27 00:02:06,552 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure e80833319d87b98c277e134031aa5fb1, server=jenkins-hbase9.apache.org,41869,1695772857056 in 180 msec 2023-09-27 00:02:06,553 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-09-27 00:02:06,553 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 37b68fc7a2afce55fcfb8fbe7bcd057f, server=jenkins-hbase9.apache.org,36739,1695772857140 in 181 msec 2023-09-27 00:02:06,554 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e80833319d87b98c277e134031aa5fb1, ASSIGN in 342 msec 2023-09-27 00:02:06,555 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=59, resume processing ppid=57 2023-09-27 00:02:06,555 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=37b68fc7a2afce55fcfb8fbe7bcd057f, ASSIGN in 343 msec 2023-09-27 00:02:06,556 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-27 00:02:06,556 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695772926556"}]},"ts":"1695772926556"} 2023-09-27 00:02:06,557 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-09-27 00:02:06,560 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-09-27 00:02:06,560 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-09-27 00:02:06,562 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41869] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-27 00:02:06,564 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:02:06,564 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:02:06,564 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:02:06,564 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:02:06,566 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 00:02:06,566 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 00:02:06,566 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 00:02:06,566 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 00:02:06,567 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 423 msec 2023-09-27 00:02:06,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-27 00:02:06,752 INFO [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-09-27 00:02:06,754 DEBUG [Listener at jenkins-hbase9.apache.org/45033] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,754 DEBUG [Listener at jenkins-hbase9.apache.org/45033] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695772926143.e80833319d87b98c277e134031aa5fb1. 2023-09-27 00:02:06,757 INFO [Listener at jenkins-hbase9.apache.org/45033] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 00:02:06,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-27 00:02:06,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695772926771 (current time:1695772926771). 2023-09-27 00:02:06,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 00:02:06,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(139): Connect 0x61ad9e2c to 127.0.0.1:57983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 00:02:06,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46749e30, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 00:02:06,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 00:02:06,784 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:54066, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 00:02:06,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x61ad9e2c to 127.0.0.1:57983 2023-09-27 00:02:06,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 00:02:06,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(139): Connect 0x6483e561 to 127.0.0.1:57983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 00:02:06,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69d25b23, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 00:02:06,794 DEBUG [hconnection-0xbb5dd37-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 00:02:06,797 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:54078, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 00:02:06,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6483e561 to 127.0.0.1:57983 2023-09-27 00:02:06,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 00:02:06,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-27 00:02:06,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 00:02:06,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-27 00:02:06,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-27 00:02:06,806 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-27 00:02:06,807 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695773526807 2023-09-27 00:02:06,807 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-27 00:02:06,808 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 00:02:06,808 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 00:02:06,809 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-27 00:02:06,809 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-27 00:02:06,810 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-27 00:02:06,811 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-27 00:02:06,812 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695773526811 2023-09-27 00:02:06,830 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,830 INFO [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-27 00:02:06,830 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:02:06,832 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-27 00:02:06,832 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-27 00:02:06,832 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,832 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,834 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:02:06,834 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:02:06,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:02:06,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:02:06,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:02:06,834 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:02:06,834 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:06,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:02:06,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:02:06,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:02:06,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,834 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:06,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,835 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:06,835 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,835 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,835 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:06,835 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 00:02:06,835 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-27 00:02:06,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-27 00:02:06,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,835 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-27 00:02:06,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-27 00:02:06,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,835 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-27 00:02:06,836 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-27 00:02:06,836 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,836 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-27 00:02:06,836 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,836 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:02:06,836 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-27 00:02:06,837 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-27 00:02:06,837 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-27 00:02:06,836 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,837 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,36739,1695772857140' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-27 00:02:06,837 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-27 00:02:06,837 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:02:06,837 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:02:06,839 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-27 00:02:06,839 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-27 00:02:06,839 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-27 00:02:06,839 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-27 00:02:06,839 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41869,1695772857056' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-27 00:02:06,840 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41703,1695772857103' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-27 00:02:06,841 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:06,841 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:06,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:02:06,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:02:06,843 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:06,843 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,844 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:02:06,844 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 00:02:06,844 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,844 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 00:02:06,844 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:02:06,845 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,845 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 00:02:06,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:06,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:06,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:06,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:02:06,846 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,36739,1695772857140' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-27 00:02:06,846 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3202bb6b[Count = 1] remaining members to acquire global barrier 2023-09-27 00:02:06,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:06,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:02:06,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:02:06,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:02:06,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:02:06,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:06,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:06,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:06,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:02:06,848 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,41869,1695772857056' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-27 00:02:06,848 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3202bb6b[Count = 0] remaining members to acquire global barrier 2023-09-27 00:02:06,848 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-27 00:02:06,848 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,849 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,849 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,849 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,850 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:06,850 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-27 00:02:06,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,850 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 00:02:06,850 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:06,850 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695772926143.37b68fc7a2afce55fcfb8fbe7bcd057f. 2023-09-27 00:02:06,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,850 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695772926143.37b68fc7a2afce55fcfb8fbe7bcd057f. started... 2023-09-27 00:02:06,850 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-27 00:02:06,850 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 00:02:06,850 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 00:02:06,850 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-27 00:02:06,850 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-27 00:02:06,851 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 37b68fc7a2afce55fcfb8fbe7bcd057f: 2023-09-27 00:02:06,852 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,41703,1695772857103' in zk 2023-09-27 00:02:06,852 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 00:02:06,852 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 00:02:06,852 DEBUG [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695772926143.e80833319d87b98c277e134031aa5fb1. 2023-09-27 00:02:06,852 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695772926143.37b68fc7a2afce55fcfb8fbe7bcd057f.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,852 DEBUG [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695772926143.e80833319d87b98c277e134031aa5fb1. started... 2023-09-27 00:02:06,852 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 00:02:06,852 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 00:02:06,852 DEBUG [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e80833319d87b98c277e134031aa5fb1: 2023-09-27 00:02:06,852 DEBUG [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695772926143.e80833319d87b98c277e134031aa5fb1.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,852 DEBUG [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 00:02:06,852 DEBUG [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 00:02:06,859 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-27 00:02:06,859 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:02:06,859 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-27 00:02:06,865 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695772926143.37b68fc7a2afce55fcfb8fbe7bcd057f. completed. 2023-09-27 00:02:06,865 DEBUG [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695772926143.e80833319d87b98c277e134031aa5fb1. completed. 2023-09-27 00:02:06,865 DEBUG [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695772926143.e80833319d87b98c277e134031aa5fb1. 2023-09-27 00:02:06,865 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695772926143.37b68fc7a2afce55fcfb8fbe7bcd057f. 2023-09-27 00:02:06,865 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 00:02:06,865 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 00:02:06,865 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:06,865 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 00:02:06,865 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 00:02:06,865 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:06,865 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-27 00:02:06,865 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-27 00:02:06,865 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,36739,1695772857140' in zk 2023-09-27 00:02:06,865 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,41869,1695772857056' in zk 2023-09-27 00:02:06,867 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-27 00:02:06,867 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:06,867 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-27 00:02:06,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:06,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:02:06,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:02:06,867 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:02:06,867 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:06,867 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-27 00:02:06,867 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:02:06,869 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-27 00:02:06,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:02:06,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:02:06,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:06,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:06,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:06,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:02:06,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:06,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:06,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:06,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,41869,1695772857056': 2023-09-27 00:02:06,873 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,41869,1695772857056' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-27 00:02:06,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:06,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:02:06,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:02:06,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:02:06,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:02:06,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:06,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:06,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:06,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:02:06,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:06,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:06,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:06,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,36739,1695772857140': 2023-09-27 00:02:06,876 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,36739,1695772857140' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-27 00:02:06,876 INFO [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-27 00:02:06,877 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 00:02:06,877 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 00:02:06,877 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,877 INFO [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 00:02:06,878 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,878 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,879 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:02:06,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:02:06,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:02:06,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,878 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,878 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,879 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:02:06,879 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:02:06,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:02:06,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:02:06,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:02:06,879 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:06,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:02:06,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:02:06,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:02:06,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:02:06,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,880 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:06,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:02:06,880 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:06,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:06,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:06,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:06,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:02:06,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,882 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:06,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:06,882 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:06,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:06,883 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:06,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:06,885 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:06,885 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,886 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:02:06,886 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:06,886 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:06,886 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,886 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:02:06,886 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:06,886 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:02:06,886 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,886 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:02:06,889 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:02:06,889 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:06,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:02:06,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:02:06,889 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:02:06,886 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:02:06,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:02:06,890 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:02:06,890 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:06,890 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,890 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,890 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:02:06,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:02:06,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:02:06,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:02:06,890 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:02:06,890 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 00:02:06,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:02:06,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:02:06,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:02:06,891 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-27 00:02:06,903 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,904 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,908 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 00:02:06,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-27 00:02:06,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-27 00:02:06,910 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 00:02:06,926 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,926 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-27 00:02:06,926 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,927 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:06,927 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695772926807Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695772926903 (+96 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695772926903Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695772926903Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695772926908 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695772926920 (+12 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695772926926 (+6 ms) 2023-09-27 00:02:06,929 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-27 00:02:06,931 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 122 msec 2023-09-27 00:02:07,110 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 00:02:07,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-27 00:02:07,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 00:02:07,113 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41869] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1695772926143.e80833319d87b98c277e134031aa5fb1. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 00:02:07,114 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36739] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1695772926143.37b68fc7a2afce55fcfb8fbe7bcd057f. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 00:02:07,117 DEBUG [Listener at jenkins-hbase9.apache.org/45033] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,117 DEBUG [Listener at jenkins-hbase9.apache.org/45033] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695772926143.e80833319d87b98c277e134031aa5fb1. 2023-09-27 00:02:07,117 INFO [Listener at jenkins-hbase9.apache.org/45033] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 00:02:07,127 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-27 00:02:07,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695772927127 (current time:1695772927127). 2023-09-27 00:02:07,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 00:02:07,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(139): Connect 0x519b4414 to 127.0.0.1:57983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 00:02:07,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e2f947a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 00:02:07,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 00:02:07,138 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:54080, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 00:02:07,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x519b4414 to 127.0.0.1:57983 2023-09-27 00:02:07,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 00:02:07,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(139): Connect 0x576a626a to 127.0.0.1:57983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 00:02:07,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c5a2777, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 00:02:07,147 DEBUG [hconnection-0xe84e4c2-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 00:02:07,149 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:54094, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 00:02:07,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x576a626a to 127.0.0.1:57983 2023-09-27 00:02:07,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 00:02:07,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-27 00:02:07,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 00:02:07,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-27 00:02:07,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-27 00:02:07,157 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-27 00:02:07,158 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695773527158 2023-09-27 00:02:07,158 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-27 00:02:07,159 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 00:02:07,159 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 00:02:07,160 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-27 00:02:07,160 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-27 00:02:07,161 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 4 msec 2023-09-27 00:02:07,162 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-27 00:02:07,163 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695773527163 2023-09-27 00:02:07,171 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,171 INFO [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-27 00:02:07,171 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:02:07,172 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-27 00:02:07,172 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-27 00:02:07,172 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,172 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,174 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:02:07,174 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:02:07,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:02:07,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:02:07,174 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:02:07,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:02:07,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:02:07,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:02:07,175 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:07,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:02:07,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,175 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:07,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,175 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,175 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:07,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,176 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-27 00:02:07,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,176 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:07,176 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 00:02:07,176 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,176 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-27 00:02:07,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-27 00:02:07,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,176 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-27 00:02:07,176 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-27 00:02:07,176 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:02:07,176 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-27 00:02:07,177 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-27 00:02:07,178 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-27 00:02:07,178 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41869,1695772857056' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-27 00:02:07,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,178 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,178 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-27 00:02:07,178 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-27 00:02:07,178 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:02:07,178 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,179 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-27 00:02:07,180 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-27 00:02:07,180 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:02:07,180 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-27 00:02:07,181 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41703,1695772857103' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-27 00:02:07,180 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,180 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-27 00:02:07,181 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-27 00:02:07,181 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,36739,1695772857140' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-27 00:02:07,180 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:07,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:07,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:02:07,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:02:07,181 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,181 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 00:02:07,182 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:02:07,183 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:07,183 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:02:07,183 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,183 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 00:02:07,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,183 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,183 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 00:02:07,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:07,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:07,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:07,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:02:07,184 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,41869,1695772857056' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-27 00:02:07,184 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@415b96f3[Count = 1] remaining members to acquire global barrier 2023-09-27 00:02:07,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:07,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:02:07,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:02:07,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:02:07,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:02:07,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:07,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:07,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:07,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:02:07,186 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,36739,1695772857140' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-27 00:02:07,186 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@415b96f3[Count = 0] remaining members to acquire global barrier 2023-09-27 00:02:07,186 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-27 00:02:07,186 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,188 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,188 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,188 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,189 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-27 00:02:07,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,189 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-27 00:02:07,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,189 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 00:02:07,189 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 00:02:07,189 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:07,189 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695772926143.37b68fc7a2afce55fcfb8fbe7bcd057f. 2023-09-27 00:02:07,189 DEBUG [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695772926143.e80833319d87b98c277e134031aa5fb1. 2023-09-27 00:02:07,189 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695772926143.37b68fc7a2afce55fcfb8fbe7bcd057f. started... 2023-09-27 00:02:07,189 DEBUG [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695772926143.e80833319d87b98c277e134031aa5fb1. started... 2023-09-27 00:02:07,189 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 00:02:07,189 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 00:02:07,189 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-27 00:02:07,189 INFO [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 37b68fc7a2afce55fcfb8fbe7bcd057f 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-27 00:02:07,189 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:07,189 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 00:02:07,189 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-27 00:02:07,190 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,41703,1695772857103' in zk 2023-09-27 00:02:07,189 INFO [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e80833319d87b98c277e134031aa5fb1 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-27 00:02:07,191 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-27 00:02:07,191 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:02:07,191 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-27 00:02:07,206 INFO [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023092701424e079dda46c99666af59598b5320 to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023092701424e079dda46c99666af59598b5320 2023-09-27 00:02:07,207 INFO [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230927924f9cbef0844dc1a0ecf5767efba7e5 to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230927924f9cbef0844dc1a0ecf5767efba7e5 2023-09-27 00:02:07,213 INFO [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion/e80833319d87b98c277e134031aa5fb1/.tmp/cf/e80ca1139a3040d1afc39aaacdfd3719 2023-09-27 00:02:07,214 INFO [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion/37b68fc7a2afce55fcfb8fbe7bcd057f/.tmp/cf/bc3544d1cbde4cd095ddcc82f37f4e74 2023-09-27 00:02:07,218 DEBUG [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion/e80833319d87b98c277e134031aa5fb1/.tmp/cf/e80ca1139a3040d1afc39aaacdfd3719 as hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion/e80833319d87b98c277e134031aa5fb1/cf/e80ca1139a3040d1afc39aaacdfd3719 2023-09-27 00:02:07,219 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion/37b68fc7a2afce55fcfb8fbe7bcd057f/.tmp/cf/bc3544d1cbde4cd095ddcc82f37f4e74 as hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion/37b68fc7a2afce55fcfb8fbe7bcd057f/cf/bc3544d1cbde4cd095ddcc82f37f4e74 2023-09-27 00:02:07,223 INFO [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion/e80833319d87b98c277e134031aa5fb1/cf/e80ca1139a3040d1afc39aaacdfd3719, entries=2, sequenceid=6, filesize=5.3 K 2023-09-27 00:02:07,224 INFO [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for e80833319d87b98c277e134031aa5fb1 in 35ms, sequenceid=6, compaction requested=false 2023-09-27 00:02:07,224 DEBUG [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-27 00:02:07,224 INFO [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion/37b68fc7a2afce55fcfb8fbe7bcd057f/cf/bc3544d1cbde4cd095ddcc82f37f4e74, entries=48, sequenceid=6, filesize=13.7 K 2023-09-27 00:02:07,224 DEBUG [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e80833319d87b98c277e134031aa5fb1: 2023-09-27 00:02:07,225 DEBUG [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695772926143.e80833319d87b98c277e134031aa5fb1.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,225 DEBUG [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 00:02:07,225 DEBUG [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion/e80833319d87b98c277e134031aa5fb1/cf/e80ca1139a3040d1afc39aaacdfd3719] hfiles 2023-09-27 00:02:07,225 DEBUG [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion/e80833319d87b98c277e134031aa5fb1/cf/e80ca1139a3040d1afc39aaacdfd3719 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,225 INFO [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 37b68fc7a2afce55fcfb8fbe7bcd057f in 36ms, sequenceid=6, compaction requested=false 2023-09-27 00:02:07,227 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 37b68fc7a2afce55fcfb8fbe7bcd057f: 2023-09-27 00:02:07,227 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695772926143.37b68fc7a2afce55fcfb8fbe7bcd057f.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,227 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 00:02:07,227 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion/37b68fc7a2afce55fcfb8fbe7bcd057f/cf/bc3544d1cbde4cd095ddcc82f37f4e74] hfiles 2023-09-27 00:02:07,227 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion/37b68fc7a2afce55fcfb8fbe7bcd057f/cf/bc3544d1cbde4cd095ddcc82f37f4e74 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,236 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695772926143.37b68fc7a2afce55fcfb8fbe7bcd057f. completed. 2023-09-27 00:02:07,236 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695772926143.37b68fc7a2afce55fcfb8fbe7bcd057f. 2023-09-27 00:02:07,236 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 00:02:07,237 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 00:02:07,236 DEBUG [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695772926143.e80833319d87b98c277e134031aa5fb1. completed. 2023-09-27 00:02:07,237 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:07,237 DEBUG [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695772926143.e80833319d87b98c277e134031aa5fb1. 2023-09-27 00:02:07,237 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-27 00:02:07,237 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 00:02:07,237 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 00:02:07,237 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:07,237 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,36739,1695772857140' in zk 2023-09-27 00:02:07,237 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-27 00:02:07,237 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,41869,1695772857056' in zk 2023-09-27 00:02:07,239 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:07,239 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-27 00:02:07,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:07,239 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:07,239 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-27 00:02:07,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:02:07,239 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:02:07,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:02:07,239 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:02:07,239 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-27 00:02:07,241 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-27 00:02:07,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:02:07,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:02:07,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:07,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:07,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:07,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:02:07,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:07,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:07,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:07,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,41869,1695772857056': 2023-09-27 00:02:07,246 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,41869,1695772857056' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-27 00:02:07,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:07,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:02:07,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:02:07,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:02:07,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:02:07,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:07,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:07,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:07,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:02:07,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:07,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:07,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:07,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,36739,1695772857140': 2023-09-27 00:02:07,249 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,36739,1695772857140' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-27 00:02:07,249 INFO [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-27 00:02:07,249 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 00:02:07,249 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 00:02:07,249 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,249 INFO [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 00:02:07,255 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,255 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,255 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,255 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,256 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:02:07,256 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:07,256 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:02:07,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:02:07,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:02:07,255 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:02:07,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:02:07,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:02:07,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:02:07,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:02:07,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:02:07,256 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:07,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:02:07,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:02:07,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,257 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:07,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:02:07,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:07,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:07,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:07,258 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:07,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:02:07,259 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:07,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,259 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:07,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:07,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:07,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:07,259 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 00:02:07,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-27 00:02:07,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-27 00:02:07,261 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 00:02:07,262 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:02:07,262 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:02:07,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:02:07,262 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:02:07,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:02:07,262 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:02:07,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:02:07,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:02:07,262 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:02:07,262 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:07,262 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:02:07,263 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,263 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:02:07,264 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:07,264 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:07,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:02:07,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:02:07,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:02:07,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:02:07,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:02:07,262 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:02:07,264 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,264 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,264 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,264 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:07,264 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 00:02:07,264 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,264 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:07,264 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:07,264 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,264 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:02:07,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:02:07,265 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230927924f9cbef0844dc1a0ecf5767efba7e5, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023092701424e079dda46c99666af59598b5320] mob files 2023-09-27 00:02:07,265 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230927924f9cbef0844dc1a0ecf5767efba7e5 2023-09-27 00:02:07,265 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023092701424e079dda46c99666af59598b5320 2023-09-27 00:02:07,272 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,272 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,289 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,289 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-27 00:02:07,289 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,290 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:07,290 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695772927158Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695772927272 (+114 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695772927272Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1695772927272Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1695772927275 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695772927282 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695772927289 (+7 ms) 2023-09-27 00:02:07,292 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-27 00:02:07,294 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 133 msec 2023-09-27 00:02:07,461 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 00:02:07,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-27 00:02:07,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 00:02:07,490 DEBUG [Listener at jenkins-hbase9.apache.org/45033] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-27 00:02:07,493 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43518, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-27 00:02:07,495 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36739] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-27 00:02:07,496 DEBUG [Listener at jenkins-hbase9.apache.org/45033] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-27 00:02:07,500 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58032, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-27 00:02:07,500 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41703] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-27 00:02:07,501 DEBUG [Listener at jenkins-hbase9.apache.org/45033] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-27 00:02:07,505 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:36956, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-27 00:02:07,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41869] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-27 00:02:07,507 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-27 00:02:07,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:07,511 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-09-27 00:02:07,511 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-09-27 00:02:07,512 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-27 00:02:07,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-27 00:02:07,515 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d5a409dd68a2fec34d269a7d05617331 2023-09-27 00:02:07,515 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccc4ccaea05558cc11f25992cfe36f14 2023-09-27 00:02:07,516 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d5a409dd68a2fec34d269a7d05617331 empty. 2023-09-27 00:02:07,516 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccc4ccaea05558cc11f25992cfe36f14 empty. 2023-09-27 00:02:07,516 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d5a409dd68a2fec34d269a7d05617331 2023-09-27 00:02:07,516 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccc4ccaea05558cc11f25992cfe36f14 2023-09-27 00:02:07,516 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-27 00:02:07,529 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-09-27 00:02:07,530 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => d5a409dd68a2fec34d269a7d05617331, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927507.d5a409dd68a2fec34d269a7d05617331.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp 2023-09-27 00:02:07,530 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => ccc4ccaea05558cc11f25992cfe36f14, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695772927507.ccc4ccaea05558cc11f25992cfe36f14.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp 2023-09-27 00:02:07,537 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695772927507.ccc4ccaea05558cc11f25992cfe36f14.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 00:02:07,537 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing ccc4ccaea05558cc11f25992cfe36f14, disabling compactions & flushes 2023-09-27 00:02:07,537 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695772927507.ccc4ccaea05558cc11f25992cfe36f14. 2023-09-27 00:02:07,537 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695772927507.ccc4ccaea05558cc11f25992cfe36f14. 2023-09-27 00:02:07,537 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927507.d5a409dd68a2fec34d269a7d05617331.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 00:02:07,537 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695772927507.ccc4ccaea05558cc11f25992cfe36f14. after waiting 0 ms 2023-09-27 00:02:07,538 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing d5a409dd68a2fec34d269a7d05617331, disabling compactions & flushes 2023-09-27 00:02:07,538 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695772927507.ccc4ccaea05558cc11f25992cfe36f14. 2023-09-27 00:02:07,538 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927507.d5a409dd68a2fec34d269a7d05617331. 2023-09-27 00:02:07,538 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695772927507.ccc4ccaea05558cc11f25992cfe36f14. 2023-09-27 00:02:07,538 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927507.d5a409dd68a2fec34d269a7d05617331. 2023-09-27 00:02:07,538 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927507.d5a409dd68a2fec34d269a7d05617331. after waiting 0 ms 2023-09-27 00:02:07,538 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927507.d5a409dd68a2fec34d269a7d05617331. 2023-09-27 00:02:07,538 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for ccc4ccaea05558cc11f25992cfe36f14: 2023-09-27 00:02:07,538 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927507.d5a409dd68a2fec34d269a7d05617331. 2023-09-27 00:02:07,538 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for d5a409dd68a2fec34d269a7d05617331: 2023-09-27 00:02:07,540 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-09-27 00:02:07,541 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695772927507.ccc4ccaea05558cc11f25992cfe36f14.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695772927541"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695772927541"}]},"ts":"1695772927541"} 2023-09-27 00:02:07,541 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927507.d5a409dd68a2fec34d269a7d05617331.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695772927541"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695772927541"}]},"ts":"1695772927541"} 2023-09-27 00:02:07,543 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-27 00:02:07,544 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-27 00:02:07,544 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695772927544"}]},"ts":"1695772927544"} 2023-09-27 00:02:07,545 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-09-27 00:02:07,548 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-09-27 00:02:07,549 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 00:02:07,549 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 00:02:07,549 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 00:02:07,549 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 00:02:07,550 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d5a409dd68a2fec34d269a7d05617331, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ccc4ccaea05558cc11f25992cfe36f14, ASSIGN}] 2023-09-27 00:02:07,552 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d5a409dd68a2fec34d269a7d05617331, ASSIGN 2023-09-27 00:02:07,552 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ccc4ccaea05558cc11f25992cfe36f14, ASSIGN 2023-09-27 00:02:07,553 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d5a409dd68a2fec34d269a7d05617331, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,41869,1695772857056; forceNewPlan=false, retain=false 2023-09-27 00:02:07,553 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ccc4ccaea05558cc11f25992cfe36f14, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,41703,1695772857103; forceNewPlan=false, retain=false 2023-09-27 00:02:07,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-27 00:02:07,703 INFO [jenkins-hbase9:33541] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-27 00:02:07,707 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=ccc4ccaea05558cc11f25992cfe36f14, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:07,707 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=d5a409dd68a2fec34d269a7d05617331, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:07,707 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695772927507.ccc4ccaea05558cc11f25992cfe36f14.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695772927707"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695772927707"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695772927707"}]},"ts":"1695772927707"} 2023-09-27 00:02:07,707 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927507.d5a409dd68a2fec34d269a7d05617331.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695772927707"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695772927707"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695772927707"}]},"ts":"1695772927707"} 2023-09-27 00:02:07,711 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure ccc4ccaea05558cc11f25992cfe36f14, server=jenkins-hbase9.apache.org,41703,1695772857103}] 2023-09-27 00:02:07,712 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure d5a409dd68a2fec34d269a7d05617331, server=jenkins-hbase9.apache.org,41869,1695772857056}] 2023-09-27 00:02:07,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-27 00:02:07,866 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1695772927507.ccc4ccaea05558cc11f25992cfe36f14. 2023-09-27 00:02:07,866 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927507.d5a409dd68a2fec34d269a7d05617331. 2023-09-27 00:02:07,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ccc4ccaea05558cc11f25992cfe36f14, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695772927507.ccc4ccaea05558cc11f25992cfe36f14.', STARTKEY => '2', ENDKEY => ''} 2023-09-27 00:02:07,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d5a409dd68a2fec34d269a7d05617331, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927507.d5a409dd68a2fec34d269a7d05617331.', STARTKEY => '', ENDKEY => '2'} 2023-09-27 00:02:07,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927507.d5a409dd68a2fec34d269a7d05617331. service=AccessControlService 2023-09-27 00:02:07,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1695772927507.ccc4ccaea05558cc11f25992cfe36f14. service=AccessControlService 2023-09-27 00:02:07,867 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 00:02:07,867 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 00:02:07,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 d5a409dd68a2fec34d269a7d05617331 2023-09-27 00:02:07,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 ccc4ccaea05558cc11f25992cfe36f14 2023-09-27 00:02:07,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927507.d5a409dd68a2fec34d269a7d05617331.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 00:02:07,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695772927507.ccc4ccaea05558cc11f25992cfe36f14.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 00:02:07,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for d5a409dd68a2fec34d269a7d05617331 2023-09-27 00:02:07,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for ccc4ccaea05558cc11f25992cfe36f14 2023-09-27 00:02:07,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for d5a409dd68a2fec34d269a7d05617331 2023-09-27 00:02:07,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for ccc4ccaea05558cc11f25992cfe36f14 2023-09-27 00:02:07,869 INFO [StoreOpener-ccc4ccaea05558cc11f25992cfe36f14-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ccc4ccaea05558cc11f25992cfe36f14 2023-09-27 00:02:07,869 INFO [StoreOpener-d5a409dd68a2fec34d269a7d05617331-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d5a409dd68a2fec34d269a7d05617331 2023-09-27 00:02:07,870 DEBUG [StoreOpener-d5a409dd68a2fec34d269a7d05617331-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d5a409dd68a2fec34d269a7d05617331/cf 2023-09-27 00:02:07,871 DEBUG [StoreOpener-d5a409dd68a2fec34d269a7d05617331-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d5a409dd68a2fec34d269a7d05617331/cf 2023-09-27 00:02:07,871 DEBUG [StoreOpener-ccc4ccaea05558cc11f25992cfe36f14-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccc4ccaea05558cc11f25992cfe36f14/cf 2023-09-27 00:02:07,871 DEBUG [StoreOpener-ccc4ccaea05558cc11f25992cfe36f14-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccc4ccaea05558cc11f25992cfe36f14/cf 2023-09-27 00:02:07,871 INFO [StoreOpener-d5a409dd68a2fec34d269a7d05617331-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d5a409dd68a2fec34d269a7d05617331 columnFamilyName cf 2023-09-27 00:02:07,871 INFO [StoreOpener-ccc4ccaea05558cc11f25992cfe36f14-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ccc4ccaea05558cc11f25992cfe36f14 columnFamilyName cf 2023-09-27 00:02:07,872 INFO [StoreOpener-d5a409dd68a2fec34d269a7d05617331-1] regionserver.HStore(310): Store=d5a409dd68a2fec34d269a7d05617331/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 00:02:07,872 INFO [StoreOpener-ccc4ccaea05558cc11f25992cfe36f14-1] regionserver.HStore(310): Store=ccc4ccaea05558cc11f25992cfe36f14/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 00:02:07,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccc4ccaea05558cc11f25992cfe36f14 2023-09-27 00:02:07,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d5a409dd68a2fec34d269a7d05617331 2023-09-27 00:02:07,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccc4ccaea05558cc11f25992cfe36f14 2023-09-27 00:02:07,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d5a409dd68a2fec34d269a7d05617331 2023-09-27 00:02:07,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for d5a409dd68a2fec34d269a7d05617331 2023-09-27 00:02:07,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for ccc4ccaea05558cc11f25992cfe36f14 2023-09-27 00:02:07,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d5a409dd68a2fec34d269a7d05617331/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 00:02:07,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccc4ccaea05558cc11f25992cfe36f14/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 00:02:07,884 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened d5a409dd68a2fec34d269a7d05617331; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70167544, jitterRate=0.04557788372039795}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 00:02:07,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for d5a409dd68a2fec34d269a7d05617331: 2023-09-27 00:02:07,885 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened ccc4ccaea05558cc11f25992cfe36f14; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67826058, jitterRate=0.010687023401260376}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 00:02:07,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for ccc4ccaea05558cc11f25992cfe36f14: 2023-09-27 00:02:07,886 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927507.d5a409dd68a2fec34d269a7d05617331., pid=70, masterSystemTime=1695772927863 2023-09-27 00:02:07,886 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695772927507.ccc4ccaea05558cc11f25992cfe36f14., pid=69, masterSystemTime=1695772927863 2023-09-27 00:02:07,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927507.d5a409dd68a2fec34d269a7d05617331. 2023-09-27 00:02:07,887 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927507.d5a409dd68a2fec34d269a7d05617331. 2023-09-27 00:02:07,888 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=d5a409dd68a2fec34d269a7d05617331, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:07,888 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927507.d5a409dd68a2fec34d269a7d05617331.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695772927888"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695772927888"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695772927888"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695772927888"}]},"ts":"1695772927888"} 2023-09-27 00:02:07,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695772927507.ccc4ccaea05558cc11f25992cfe36f14. 2023-09-27 00:02:07,888 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1695772927507.ccc4ccaea05558cc11f25992cfe36f14. 2023-09-27 00:02:07,889 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=ccc4ccaea05558cc11f25992cfe36f14, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:07,889 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695772927507.ccc4ccaea05558cc11f25992cfe36f14.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695772927889"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695772927889"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695772927889"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695772927889"}]},"ts":"1695772927889"} 2023-09-27 00:02:07,892 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=67 2023-09-27 00:02:07,892 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure d5a409dd68a2fec34d269a7d05617331, server=jenkins-hbase9.apache.org,41869,1695772857056 in 178 msec 2023-09-27 00:02:07,893 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=68 2023-09-27 00:02:07,893 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure ccc4ccaea05558cc11f25992cfe36f14, server=jenkins-hbase9.apache.org,41703,1695772857103 in 180 msec 2023-09-27 00:02:07,893 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d5a409dd68a2fec34d269a7d05617331, ASSIGN in 342 msec 2023-09-27 00:02:07,894 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=66 2023-09-27 00:02:07,895 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ccc4ccaea05558cc11f25992cfe36f14, ASSIGN in 343 msec 2023-09-27 00:02:07,895 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-27 00:02:07,895 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695772927895"}]},"ts":"1695772927895"} 2023-09-27 00:02:07,896 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-09-27 00:02:07,899 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-09-27 00:02:07,900 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-09-27 00:02:07,901 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41869] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-27 00:02:07,903 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:02:07,903 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:02:07,903 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:02:07,903 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:02:07,905 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 00:02:07,905 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 00:02:07,905 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-27 00:02:07,905 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-27 00:02:07,905 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 00:02:07,905 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 00:02:07,905 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-27 00:02:07,905 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-27 00:02:07,906 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 396 msec 2023-09-27 00:02:08,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-27 00:02:08,118 INFO [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-09-27 00:02:08,140 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.HMaster$2(1952): Client=jenkins//172.31.2.10 merge regions d5a409dd68a2fec34d269a7d05617331, ccc4ccaea05558cc11f25992cfe36f14 2023-09-27 00:02:08,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d5a409dd68a2fec34d269a7d05617331, ccc4ccaea05558cc11f25992cfe36f14], force=true 2023-09-27 00:02:08,150 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d5a409dd68a2fec34d269a7d05617331, ccc4ccaea05558cc11f25992cfe36f14], force=true 2023-09-27 00:02:08,150 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d5a409dd68a2fec34d269a7d05617331, ccc4ccaea05558cc11f25992cfe36f14], force=true 2023-09-27 00:02:08,150 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d5a409dd68a2fec34d269a7d05617331, ccc4ccaea05558cc11f25992cfe36f14], force=true 2023-09-27 00:02:08,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-27 00:02:08,173 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d5a409dd68a2fec34d269a7d05617331, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ccc4ccaea05558cc11f25992cfe36f14, UNASSIGN}] 2023-09-27 00:02:08,175 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d5a409dd68a2fec34d269a7d05617331, UNASSIGN 2023-09-27 00:02:08,175 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ccc4ccaea05558cc11f25992cfe36f14, UNASSIGN 2023-09-27 00:02:08,176 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=d5a409dd68a2fec34d269a7d05617331, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:08,176 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=ccc4ccaea05558cc11f25992cfe36f14, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:08,176 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927507.d5a409dd68a2fec34d269a7d05617331.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695772928176"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695772928176"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695772928176"}]},"ts":"1695772928176"} 2023-09-27 00:02:08,176 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695772927507.ccc4ccaea05558cc11f25992cfe36f14.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695772928176"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695772928176"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695772928176"}]},"ts":"1695772928176"} 2023-09-27 00:02:08,178 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure d5a409dd68a2fec34d269a7d05617331, server=jenkins-hbase9.apache.org,41869,1695772857056}] 2023-09-27 00:02:08,179 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure ccc4ccaea05558cc11f25992cfe36f14, server=jenkins-hbase9.apache.org,41703,1695772857103}] 2023-09-27 00:02:08,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-27 00:02:08,330 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close d5a409dd68a2fec34d269a7d05617331 2023-09-27 00:02:08,332 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing d5a409dd68a2fec34d269a7d05617331, disabling compactions & flushes 2023-09-27 00:02:08,332 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927507.d5a409dd68a2fec34d269a7d05617331. 2023-09-27 00:02:08,332 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927507.d5a409dd68a2fec34d269a7d05617331. 2023-09-27 00:02:08,332 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927507.d5a409dd68a2fec34d269a7d05617331. after waiting 0 ms 2023-09-27 00:02:08,332 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927507.d5a409dd68a2fec34d269a7d05617331. 2023-09-27 00:02:08,332 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing d5a409dd68a2fec34d269a7d05617331 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-27 00:02:08,332 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close ccc4ccaea05558cc11f25992cfe36f14 2023-09-27 00:02:08,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing ccc4ccaea05558cc11f25992cfe36f14, disabling compactions & flushes 2023-09-27 00:02:08,334 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695772927507.ccc4ccaea05558cc11f25992cfe36f14. 2023-09-27 00:02:08,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695772927507.ccc4ccaea05558cc11f25992cfe36f14. 2023-09-27 00:02:08,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695772927507.ccc4ccaea05558cc11f25992cfe36f14. after waiting 0 ms 2023-09-27 00:02:08,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695772927507.ccc4ccaea05558cc11f25992cfe36f14. 2023-09-27 00:02:08,334 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing ccc4ccaea05558cc11f25992cfe36f14 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-27 00:02:08,345 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d5a409dd68a2fec34d269a7d05617331/.tmp/cf/c8f3fde55ed24063b8329523eba06b2d 2023-09-27 00:02:08,345 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccc4ccaea05558cc11f25992cfe36f14/.tmp/cf/80b6d252e0474ec8b012d2024e2d3ef5 2023-09-27 00:02:08,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccc4ccaea05558cc11f25992cfe36f14/.tmp/cf/80b6d252e0474ec8b012d2024e2d3ef5 as hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccc4ccaea05558cc11f25992cfe36f14/cf/80b6d252e0474ec8b012d2024e2d3ef5 2023-09-27 00:02:08,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d5a409dd68a2fec34d269a7d05617331/.tmp/cf/c8f3fde55ed24063b8329523eba06b2d as hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d5a409dd68a2fec34d269a7d05617331/cf/c8f3fde55ed24063b8329523eba06b2d 2023-09-27 00:02:08,358 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d5a409dd68a2fec34d269a7d05617331/cf/c8f3fde55ed24063b8329523eba06b2d, entries=1, sequenceid=5, filesize=4.7 K 2023-09-27 00:02:08,358 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccc4ccaea05558cc11f25992cfe36f14/cf/80b6d252e0474ec8b012d2024e2d3ef5, entries=1, sequenceid=5, filesize=4.7 K 2023-09-27 00:02:08,359 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for d5a409dd68a2fec34d269a7d05617331 in 27ms, sequenceid=5, compaction requested=false 2023-09-27 00:02:08,359 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-27 00:02:08,359 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for ccc4ccaea05558cc11f25992cfe36f14 in 25ms, sequenceid=5, compaction requested=false 2023-09-27 00:02:08,359 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-27 00:02:08,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccc4ccaea05558cc11f25992cfe36f14/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-27 00:02:08,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d5a409dd68a2fec34d269a7d05617331/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-27 00:02:08,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 00:02:08,371 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695772927507.ccc4ccaea05558cc11f25992cfe36f14. 2023-09-27 00:02:08,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 00:02:08,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for ccc4ccaea05558cc11f25992cfe36f14: 2023-09-27 00:02:08,371 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927507.d5a409dd68a2fec34d269a7d05617331. 2023-09-27 00:02:08,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for d5a409dd68a2fec34d269a7d05617331: 2023-09-27 00:02:08,373 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed ccc4ccaea05558cc11f25992cfe36f14 2023-09-27 00:02:08,373 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=ccc4ccaea05558cc11f25992cfe36f14, regionState=CLOSED 2023-09-27 00:02:08,373 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695772927507.ccc4ccaea05558cc11f25992cfe36f14.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695772928373"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695772928373"}]},"ts":"1695772928373"} 2023-09-27 00:02:08,373 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed d5a409dd68a2fec34d269a7d05617331 2023-09-27 00:02:08,374 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=d5a409dd68a2fec34d269a7d05617331, regionState=CLOSED 2023-09-27 00:02:08,374 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927507.d5a409dd68a2fec34d269a7d05617331.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695772928374"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695772928374"}]},"ts":"1695772928374"} 2023-09-27 00:02:08,376 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=73 2023-09-27 00:02:08,376 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure ccc4ccaea05558cc11f25992cfe36f14, server=jenkins-hbase9.apache.org,41703,1695772857103 in 195 msec 2023-09-27 00:02:08,377 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=72 2023-09-27 00:02:08,377 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure d5a409dd68a2fec34d269a7d05617331, server=jenkins-hbase9.apache.org,41869,1695772857056 in 197 msec 2023-09-27 00:02:08,378 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ccc4ccaea05558cc11f25992cfe36f14, UNASSIGN in 203 msec 2023-09-27 00:02:08,378 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-09-27 00:02:08,378 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d5a409dd68a2fec34d269a7d05617331, UNASSIGN in 207 msec 2023-09-27 00:02:08,430 DEBUG [PEWorker-3] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/62b598fbcd8690c88f53a7aa0248920e/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-09-27 00:02:08,432 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927507.d5a409dd68a2fec34d269a7d05617331.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-27 00:02:08,432 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695772927507.ccc4ccaea05558cc11f25992cfe36f14.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-27 00:02:08,432 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927508.62b598fbcd8690c88f53a7aa0248920e.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-27 00:02:08,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-27 00:02:08,486 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=62b598fbcd8690c88f53a7aa0248920e, ASSIGN}] 2023-09-27 00:02:08,487 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=62b598fbcd8690c88f53a7aa0248920e, ASSIGN 2023-09-27 00:02:08,487 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=62b598fbcd8690c88f53a7aa0248920e, ASSIGN; state=MERGED, location=jenkins-hbase9.apache.org,41869,1695772857056; forceNewPlan=false, retain=false 2023-09-27 00:02:08,638 INFO [jenkins-hbase9:33541] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-27 00:02:08,639 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=62b598fbcd8690c88f53a7aa0248920e, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:08,640 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927508.62b598fbcd8690c88f53a7aa0248920e.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695772928639"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695772928639"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695772928639"}]},"ts":"1695772928639"} 2023-09-27 00:02:08,641 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 62b598fbcd8690c88f53a7aa0248920e, server=jenkins-hbase9.apache.org,41869,1695772857056}] 2023-09-27 00:02:08,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-27 00:02:08,796 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927508.62b598fbcd8690c88f53a7aa0248920e. 2023-09-27 00:02:08,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 62b598fbcd8690c88f53a7aa0248920e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927508.62b598fbcd8690c88f53a7aa0248920e.', STARTKEY => '', ENDKEY => ''} 2023-09-27 00:02:08,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927508.62b598fbcd8690c88f53a7aa0248920e. service=AccessControlService 2023-09-27 00:02:08,796 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 00:02:08,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 62b598fbcd8690c88f53a7aa0248920e 2023-09-27 00:02:08,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927508.62b598fbcd8690c88f53a7aa0248920e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 00:02:08,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 62b598fbcd8690c88f53a7aa0248920e 2023-09-27 00:02:08,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 62b598fbcd8690c88f53a7aa0248920e 2023-09-27 00:02:08,798 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/62b598fbcd8690c88f53a7aa0248920e/.regioninfo 2023-09-27 00:02:08,806 INFO [StoreOpener-62b598fbcd8690c88f53a7aa0248920e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 62b598fbcd8690c88f53a7aa0248920e 2023-09-27 00:02:08,807 DEBUG [StoreOpener-62b598fbcd8690c88f53a7aa0248920e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/62b598fbcd8690c88f53a7aa0248920e/cf 2023-09-27 00:02:08,807 DEBUG [StoreOpener-62b598fbcd8690c88f53a7aa0248920e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/62b598fbcd8690c88f53a7aa0248920e/cf 2023-09-27 00:02:08,808 INFO [StoreOpener-62b598fbcd8690c88f53a7aa0248920e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 62b598fbcd8690c88f53a7aa0248920e columnFamilyName cf 2023-09-27 00:02:08,839 DEBUG [StoreOpener-62b598fbcd8690c88f53a7aa0248920e-1] regionserver.HStore(539): loaded hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/62b598fbcd8690c88f53a7aa0248920e/cf/80b6d252e0474ec8b012d2024e2d3ef5.ccc4ccaea05558cc11f25992cfe36f14->hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccc4ccaea05558cc11f25992cfe36f14/cf/80b6d252e0474ec8b012d2024e2d3ef5-top 2023-09-27 00:02:08,845 DEBUG [StoreOpener-62b598fbcd8690c88f53a7aa0248920e-1] regionserver.HStore(539): loaded hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/62b598fbcd8690c88f53a7aa0248920e/cf/c8f3fde55ed24063b8329523eba06b2d.d5a409dd68a2fec34d269a7d05617331->hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d5a409dd68a2fec34d269a7d05617331/cf/c8f3fde55ed24063b8329523eba06b2d-top 2023-09-27 00:02:08,846 INFO [StoreOpener-62b598fbcd8690c88f53a7aa0248920e-1] regionserver.HStore(310): Store=62b598fbcd8690c88f53a7aa0248920e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 00:02:08,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/62b598fbcd8690c88f53a7aa0248920e 2023-09-27 00:02:08,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/62b598fbcd8690c88f53a7aa0248920e 2023-09-27 00:02:08,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 62b598fbcd8690c88f53a7aa0248920e 2023-09-27 00:02:08,851 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 62b598fbcd8690c88f53a7aa0248920e; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71206607, jitterRate=0.061061128973960876}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 00:02:08,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 62b598fbcd8690c88f53a7aa0248920e: 2023-09-27 00:02:08,851 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927508.62b598fbcd8690c88f53a7aa0248920e., pid=77, masterSystemTime=1695772928793 2023-09-27 00:02:08,852 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927508.62b598fbcd8690c88f53a7aa0248920e.,because compaction is disabled. 2023-09-27 00:02:08,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927508.62b598fbcd8690c88f53a7aa0248920e. 2023-09-27 00:02:08,853 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927508.62b598fbcd8690c88f53a7aa0248920e. 2023-09-27 00:02:08,854 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=62b598fbcd8690c88f53a7aa0248920e, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:08,854 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927508.62b598fbcd8690c88f53a7aa0248920e.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695772928854"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695772928854"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695772928854"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695772928854"}]},"ts":"1695772928854"} 2023-09-27 00:02:08,857 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-09-27 00:02:08,857 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 62b598fbcd8690c88f53a7aa0248920e, server=jenkins-hbase9.apache.org,41869,1695772857056 in 214 msec 2023-09-27 00:02:08,858 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-09-27 00:02:08,858 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=62b598fbcd8690c88f53a7aa0248920e, ASSIGN in 371 msec 2023-09-27 00:02:08,860 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d5a409dd68a2fec34d269a7d05617331, ccc4ccaea05558cc11f25992cfe36f14], force=true in 715 msec 2023-09-27 00:02:09,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-27 00:02:09,258 INFO [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-09-27 00:02:09,259 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-27 00:02:09,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695772929259 (current time:1695772929259). 2023-09-27 00:02:09,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 00:02:09,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(139): Connect 0x5276126e to 127.0.0.1:57983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 00:02:09,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5925254b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 00:02:09,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 00:02:09,268 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:36964, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 00:02:09,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5276126e to 127.0.0.1:57983 2023-09-27 00:02:09,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 00:02:09,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(139): Connect 0x493f2b29 to 127.0.0.1:57983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 00:02:09,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b38b502, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 00:02:09,277 DEBUG [hconnection-0x5bc7c253-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 00:02:09,279 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:36980, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 00:02:09,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x493f2b29 to 127.0.0.1:57983 2023-09-27 00:02:09,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 00:02:09,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-27 00:02:09,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 00:02:09,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-27 00:02:09,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-27 00:02:09,288 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-27 00:02:09,288 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1695773529288 2023-09-27 00:02:09,288 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-27 00:02:09,292 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 00:02:09,292 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 00:02:09,292 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-27 00:02:09,293 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-27 00:02:09,294 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 7 msec 2023-09-27 00:02:09,295 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-27 00:02:09,296 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1695773529296 2023-09-27 00:02:09,309 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,309 INFO [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-09-27 00:02:09,309 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:02:09,310 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-09-27 00:02:09,310 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-09-27 00:02:09,311 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,311 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,312 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:02:09,312 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:09,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:02:09,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:02:09,312 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:02:09,312 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:02:09,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:02:09,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:02:09,313 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:09,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:02:09,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,313 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 00:02:09,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:02:09,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,313 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,313 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-27 00:02:09,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,313 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-27 00:02:09,314 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-27 00:02:09,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-27 00:02:09,314 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-27 00:02:09,314 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,314 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-27 00:02:09,314 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:02:09,314 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-27 00:02:09,314 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,316 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,316 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-27 00:02:09,316 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-27 00:02:09,315 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-27 00:02:09,316 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-27 00:02:09,316 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:02:09,316 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:02:09,317 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-27 00:02:09,318 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-27 00:02:09,318 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-27 00:02:09,318 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,36739,1695772857140' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-27 00:02:09,316 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41703,1695772857103' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-27 00:02:09,318 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-27 00:02:09,318 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41869,1695772857056' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-27 00:02:09,319 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,319 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,320 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:09,320 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,320 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,320 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 00:02:09,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:09,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:02:09,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:02:09,320 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,321 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 00:02:09,321 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,321 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 00:02:09,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:02:09,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:02:09,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:09,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:09,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:09,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:02:09,322 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,41869,1695772857056' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-09-27 00:02:09,322 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@567c78e9[Count = 0] remaining members to acquire global barrier 2023-09-27 00:02:09,322 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-09-27 00:02:09,323 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,325 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,325 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,325 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:09,325 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-27 00:02:09,325 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,325 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-27 00:02:09,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,325 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 00:02:09,325 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-27 00:02:09,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,325 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase9.apache.org,36739,1695772857140' in zk 2023-09-27 00:02:09,325 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-27 00:02:09,325 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-27 00:02:09,325 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 00:02:09,325 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 00:02:09,325 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase9.apache.org,41703,1695772857103' in zk 2023-09-27 00:02:09,325 DEBUG [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927508.62b598fbcd8690c88f53a7aa0248920e. 2023-09-27 00:02:09,325 DEBUG [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927508.62b598fbcd8690c88f53a7aa0248920e. started... 2023-09-27 00:02:09,327 DEBUG [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 62b598fbcd8690c88f53a7aa0248920e: 2023-09-27 00:02:09,327 DEBUG [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927508.62b598fbcd8690c88f53a7aa0248920e.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,327 DEBUG [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 00:02:09,327 DEBUG [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/62b598fbcd8690c88f53a7aa0248920e/cf/80b6d252e0474ec8b012d2024e2d3ef5.ccc4ccaea05558cc11f25992cfe36f14->hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccc4ccaea05558cc11f25992cfe36f14/cf/80b6d252e0474ec8b012d2024e2d3ef5-top, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/62b598fbcd8690c88f53a7aa0248920e/cf/c8f3fde55ed24063b8329523eba06b2d.d5a409dd68a2fec34d269a7d05617331->hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d5a409dd68a2fec34d269a7d05617331/cf/c8f3fde55ed24063b8329523eba06b2d-top] hfiles 2023-09-27 00:02:09,327 DEBUG [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/62b598fbcd8690c88f53a7aa0248920e/cf/80b6d252e0474ec8b012d2024e2d3ef5.ccc4ccaea05558cc11f25992cfe36f14 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,328 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-27 00:02:09,328 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:02:09,328 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-27 00:02:09,329 DEBUG [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/62b598fbcd8690c88f53a7aa0248920e/cf/c8f3fde55ed24063b8329523eba06b2d.d5a409dd68a2fec34d269a7d05617331 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,329 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-27 00:02:09,329 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:02:09,329 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-27 00:02:09,343 DEBUG [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927508.62b598fbcd8690c88f53a7aa0248920e. completed. 2023-09-27 00:02:09,343 DEBUG [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927508.62b598fbcd8690c88f53a7aa0248920e. 2023-09-27 00:02:09,343 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 00:02:09,343 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 00:02:09,343 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:09,343 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-27 00:02:09,343 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase9.apache.org,41869,1695772857056' in zk 2023-09-27 00:02:09,348 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-27 00:02:09,348 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:09,348 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:02:09,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:09,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:02:09,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:02:09,348 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-27 00:02:09,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:02:09,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:02:09,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:09,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:09,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:09,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:02:09,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:09,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:09,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:09,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase9.apache.org,41869,1695772857056': 2023-09-27 00:02:09,352 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,41869,1695772857056' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-09-27 00:02:09,352 INFO [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-09-27 00:02:09,352 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 00:02:09,352 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 00:02:09,352 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,352 INFO [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 00:02:09,353 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,354 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,354 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:02:09,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,354 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,354 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:02:09,354 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:02:09,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:02:09,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,354 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:02:09,354 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:09,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:02:09,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:02:09,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:02:09,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:02:09,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:02:09,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:02:09,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:02:09,355 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:09,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,355 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:09,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:02:09,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:09,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:09,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:09,357 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:09,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:02:09,357 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:09,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,357 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:09,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:09,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:09,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:09,360 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:09,360 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:02:09,360 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,360 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:02:09,360 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:09,360 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:02:09,360 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:09,360 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:02:09,360 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,360 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,360 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:02:09,360 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,360 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:02:09,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:02:09,361 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:02:09,360 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:09,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:02:09,361 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:02:09,361 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:09,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:02:09,361 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:09,361 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,361 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:02:09,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:02:09,361 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:02:09,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:02:09,364 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 because node does not exist (not an error) 2023-09-27 00:02:09,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:02:09,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:02:09,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:02:09,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:02:09,383 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,384 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-09-27 00:02:09,384 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,385 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,385 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1695772929288Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695772929360 (+72 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695772929361 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695772929364 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695772929377 (+13 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1695772929384 (+7 ms) 2023-09-27 00:02:09,387 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-27 00:02:09,388 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 95 msec 2023-09-27 00:02:09,392 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 00:02:09,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-09-27 00:02:09,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 00:02:09,393 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772929393 2023-09-27 00:02:09,393 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40313, tgtDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772929393, rawTgtDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772929393, srcFsUri=hdfs://localhost:40313, srcDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8 2023-09-27 00:02:09,415 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40313, inputRoot=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8 2023-09-27 00:02:09,415 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1437203190_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772929393, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772929393/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,415 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40313, inputRoot=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8, snapshotDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-09-27 00:02:09,424 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772929393/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:09,444 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-27 00:02:09,445 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-27 00:02:09,445 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-27 00:02:09,445 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-27 00:02:10,090 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695772863328_0004_000001 (auth:SIMPLE) 2023-09-27 00:02:10,304 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/hadoop-3808371440142956009.jar 2023-09-27 00:02:10,305 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-27 00:02:10,305 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-27 00:02:10,371 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/hadoop-8135424784378547218.jar 2023-09-27 00:02:10,371 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-27 00:02:10,372 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-27 00:02:10,372 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-27 00:02:10,373 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-27 00:02:10,373 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-27 00:02:10,373 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-27 00:02:10,373 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-27 00:02:10,374 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-27 00:02:10,374 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-27 00:02:10,375 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-27 00:02:10,375 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-27 00:02:10,375 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-27 00:02:10,376 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-27 00:02:10,376 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-27 00:02:10,376 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-27 00:02:10,377 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-27 00:02:10,377 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 00:02:10,378 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 00:02:10,378 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 00:02:10,378 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 00:02:10,378 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 00:02:10,379 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 00:02:10,379 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 00:02:10,722 WARN [Listener at jenkins-hbase9.apache.org/45033] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-27 00:02:10,724 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-09-27 00:02:10,726 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-09-27 00:02:10,783 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 00:02:10,783 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 00:02:10,913 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695772863328_0005_000001 (auth:SIMPLE) 2023-09-27 00:02:11,429 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-27 00:02:14,684 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695772863328_0005_000001 (auth:SIMPLE) 2023-09-27 00:02:16,898 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695772863328_0005_000001 (auth:SIMPLE) 2023-09-27 00:02:19,231 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695772863328_0005_000001 (auth:SIMPLE) 2023-09-27 00:02:20,893 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-27 00:02:20,896 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-27 00:02:20,905 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:20,905 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-27 00:02:20,906 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-27 00:02:20,906 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-728144799_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:20,906 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(367): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-27 00:02:20,906 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(367): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-27 00:02:20,906 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-728144799_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772929393/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772929393/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:20,907 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(367): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772929393/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-27 00:02:20,907 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(367): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772929393/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-27 00:02:20,913 INFO [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:20,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:20,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:20,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-27 00:02:20,918 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695772940918"}]},"ts":"1695772940918"} 2023-09-27 00:02:20,920 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-09-27 00:02:20,922 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-09-27 00:02:20,922 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=62b598fbcd8690c88f53a7aa0248920e, UNASSIGN}] 2023-09-27 00:02:20,924 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=62b598fbcd8690c88f53a7aa0248920e, UNASSIGN 2023-09-27 00:02:20,925 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=62b598fbcd8690c88f53a7aa0248920e, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:20,925 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927508.62b598fbcd8690c88f53a7aa0248920e.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695772940925"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695772940925"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695772940925"}]},"ts":"1695772940925"} 2023-09-27 00:02:20,927 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 62b598fbcd8690c88f53a7aa0248920e, server=jenkins-hbase9.apache.org,41869,1695772857056}] 2023-09-27 00:02:21,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-27 00:02:21,078 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 62b598fbcd8690c88f53a7aa0248920e 2023-09-27 00:02:21,079 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 62b598fbcd8690c88f53a7aa0248920e, disabling compactions & flushes 2023-09-27 00:02:21,079 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927508.62b598fbcd8690c88f53a7aa0248920e. 2023-09-27 00:02:21,079 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927508.62b598fbcd8690c88f53a7aa0248920e. 2023-09-27 00:02:21,079 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927508.62b598fbcd8690c88f53a7aa0248920e. after waiting 0 ms 2023-09-27 00:02:21,079 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927508.62b598fbcd8690c88f53a7aa0248920e. 2023-09-27 00:02:21,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/62b598fbcd8690c88f53a7aa0248920e/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-09-27 00:02:21,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 00:02:21,091 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927508.62b598fbcd8690c88f53a7aa0248920e. 2023-09-27 00:02:21,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 62b598fbcd8690c88f53a7aa0248920e: 2023-09-27 00:02:21,093 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 62b598fbcd8690c88f53a7aa0248920e 2023-09-27 00:02:21,093 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=62b598fbcd8690c88f53a7aa0248920e, regionState=CLOSED 2023-09-27 00:02:21,093 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927508.62b598fbcd8690c88f53a7aa0248920e.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695772941093"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695772941093"}]},"ts":"1695772941093"} 2023-09-27 00:02:21,096 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-09-27 00:02:21,096 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 62b598fbcd8690c88f53a7aa0248920e, server=jenkins-hbase9.apache.org,41869,1695772857056 in 168 msec 2023-09-27 00:02:21,097 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-09-27 00:02:21,098 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=62b598fbcd8690c88f53a7aa0248920e, UNASSIGN in 174 msec 2023-09-27 00:02:21,098 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695772941098"}]},"ts":"1695772941098"} 2023-09-27 00:02:21,099 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-09-27 00:02:21,101 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-09-27 00:02:21,103 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 188 msec 2023-09-27 00:02:21,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-27 00:02:21,221 INFO [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-09-27 00:02:21,222 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:21,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:21,225 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:21,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:21,226 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:21,227 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41869] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:21,230 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccc4ccaea05558cc11f25992cfe36f14 2023-09-27 00:02:21,230 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/62b598fbcd8690c88f53a7aa0248920e 2023-09-27 00:02:21,230 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d5a409dd68a2fec34d269a7d05617331 2023-09-27 00:02:21,230 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:21,230 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:21,230 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:21,230 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:21,231 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-27 00:02:21,231 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-27 00:02:21,231 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-27 00:02:21,231 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-27 00:02:21,232 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccc4ccaea05558cc11f25992cfe36f14/cf, FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccc4ccaea05558cc11f25992cfe36f14/recovered.edits] 2023-09-27 00:02:21,232 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/62b598fbcd8690c88f53a7aa0248920e/cf, FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/62b598fbcd8690c88f53a7aa0248920e/recovered.edits] 2023-09-27 00:02:21,232 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:21,232 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:21,232 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:02:21,232 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:21,232 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:21,232 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:02:21,232 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:02:21,232 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:02:21,233 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d5a409dd68a2fec34d269a7d05617331/cf, FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d5a409dd68a2fec34d269a7d05617331/recovered.edits] 2023-09-27 00:02:21,233 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 00:02:21,233 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 00:02:21,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-27 00:02:21,234 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 00:02:21,234 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 00:02:21,237 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/62b598fbcd8690c88f53a7aa0248920e/cf/80b6d252e0474ec8b012d2024e2d3ef5.ccc4ccaea05558cc11f25992cfe36f14 to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/62b598fbcd8690c88f53a7aa0248920e/cf/80b6d252e0474ec8b012d2024e2d3ef5.ccc4ccaea05558cc11f25992cfe36f14 2023-09-27 00:02:21,237 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccc4ccaea05558cc11f25992cfe36f14/cf/80b6d252e0474ec8b012d2024e2d3ef5 to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccc4ccaea05558cc11f25992cfe36f14/cf/80b6d252e0474ec8b012d2024e2d3ef5 2023-09-27 00:02:21,239 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d5a409dd68a2fec34d269a7d05617331/cf/c8f3fde55ed24063b8329523eba06b2d to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d5a409dd68a2fec34d269a7d05617331/cf/c8f3fde55ed24063b8329523eba06b2d 2023-09-27 00:02:21,239 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/62b598fbcd8690c88f53a7aa0248920e/cf/c8f3fde55ed24063b8329523eba06b2d.d5a409dd68a2fec34d269a7d05617331 to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/62b598fbcd8690c88f53a7aa0248920e/cf/c8f3fde55ed24063b8329523eba06b2d.d5a409dd68a2fec34d269a7d05617331 2023-09-27 00:02:21,242 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccc4ccaea05558cc11f25992cfe36f14/recovered.edits/8.seqid to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccc4ccaea05558cc11f25992cfe36f14/recovered.edits/8.seqid 2023-09-27 00:02:21,242 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccc4ccaea05558cc11f25992cfe36f14 2023-09-27 00:02:21,244 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d5a409dd68a2fec34d269a7d05617331/recovered.edits/8.seqid to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d5a409dd68a2fec34d269a7d05617331/recovered.edits/8.seqid 2023-09-27 00:02:21,245 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/62b598fbcd8690c88f53a7aa0248920e/recovered.edits/12.seqid to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/62b598fbcd8690c88f53a7aa0248920e/recovered.edits/12.seqid 2023-09-27 00:02:21,245 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d5a409dd68a2fec34d269a7d05617331 2023-09-27 00:02:21,245 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/62b598fbcd8690c88f53a7aa0248920e 2023-09-27 00:02:21,245 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-27 00:02:21,247 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:21,250 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-09-27 00:02:21,252 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-09-27 00:02:21,252 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:21,253 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-09-27 00:02:21,253 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927508.62b598fbcd8690c88f53a7aa0248920e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695772941253"}]},"ts":"9223372036854775807"} 2023-09-27 00:02:21,254 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-09-27 00:02:21,254 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 62b598fbcd8690c88f53a7aa0248920e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695772927508.62b598fbcd8690c88f53a7aa0248920e.', STARTKEY => '', ENDKEY => ''}] 2023-09-27 00:02:21,254 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-09-27 00:02:21,254 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695772941254"}]},"ts":"9223372036854775807"} 2023-09-27 00:02:21,256 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-09-27 00:02:21,258 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:21,259 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 36 msec 2023-09-27 00:02:21,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-27 00:02:21,335 INFO [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-09-27 00:02:21,335 INFO [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:21,336 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:21,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:21,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-27 00:02:21,340 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695772941340"}]},"ts":"1695772941340"} 2023-09-27 00:02:21,341 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-09-27 00:02:21,343 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-09-27 00:02:21,344 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e80833319d87b98c277e134031aa5fb1, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=37b68fc7a2afce55fcfb8fbe7bcd057f, UNASSIGN}] 2023-09-27 00:02:21,346 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e80833319d87b98c277e134031aa5fb1, UNASSIGN 2023-09-27 00:02:21,346 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=37b68fc7a2afce55fcfb8fbe7bcd057f, UNASSIGN 2023-09-27 00:02:21,346 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=37b68fc7a2afce55fcfb8fbe7bcd057f, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:21,346 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=e80833319d87b98c277e134031aa5fb1, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:21,346 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695772926143.e80833319d87b98c277e134031aa5fb1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695772941346"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695772941346"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695772941346"}]},"ts":"1695772941346"} 2023-09-27 00:02:21,346 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695772926143.37b68fc7a2afce55fcfb8fbe7bcd057f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695772941346"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695772941346"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695772941346"}]},"ts":"1695772941346"} 2023-09-27 00:02:21,348 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure e80833319d87b98c277e134031aa5fb1, server=jenkins-hbase9.apache.org,41869,1695772857056}] 2023-09-27 00:02:21,348 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 37b68fc7a2afce55fcfb8fbe7bcd057f, server=jenkins-hbase9.apache.org,36739,1695772857140}] 2023-09-27 00:02:21,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-27 00:02:21,500 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close e80833319d87b98c277e134031aa5fb1 2023-09-27 00:02:21,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing e80833319d87b98c277e134031aa5fb1, disabling compactions & flushes 2023-09-27 00:02:21,500 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695772926143.e80833319d87b98c277e134031aa5fb1. 2023-09-27 00:02:21,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695772926143.e80833319d87b98c277e134031aa5fb1. 2023-09-27 00:02:21,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695772926143.e80833319d87b98c277e134031aa5fb1. after waiting 0 ms 2023-09-27 00:02:21,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695772926143.e80833319d87b98c277e134031aa5fb1. 2023-09-27 00:02:21,501 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 37b68fc7a2afce55fcfb8fbe7bcd057f 2023-09-27 00:02:21,504 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 37b68fc7a2afce55fcfb8fbe7bcd057f, disabling compactions & flushes 2023-09-27 00:02:21,504 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695772926143.37b68fc7a2afce55fcfb8fbe7bcd057f. 2023-09-27 00:02:21,504 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695772926143.37b68fc7a2afce55fcfb8fbe7bcd057f. 2023-09-27 00:02:21,504 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695772926143.37b68fc7a2afce55fcfb8fbe7bcd057f. after waiting 0 ms 2023-09-27 00:02:21,504 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695772926143.37b68fc7a2afce55fcfb8fbe7bcd057f. 2023-09-27 00:02:21,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion/e80833319d87b98c277e134031aa5fb1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 00:02:21,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 00:02:21,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithMergeRegion/37b68fc7a2afce55fcfb8fbe7bcd057f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 00:02:21,516 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695772926143.e80833319d87b98c277e134031aa5fb1. 2023-09-27 00:02:21,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for e80833319d87b98c277e134031aa5fb1: 2023-09-27 00:02:21,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 00:02:21,517 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695772926143.37b68fc7a2afce55fcfb8fbe7bcd057f. 2023-09-27 00:02:21,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 37b68fc7a2afce55fcfb8fbe7bcd057f: 2023-09-27 00:02:21,518 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed e80833319d87b98c277e134031aa5fb1 2023-09-27 00:02:21,519 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=e80833319d87b98c277e134031aa5fb1, regionState=CLOSED 2023-09-27 00:02:21,519 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695772926143.e80833319d87b98c277e134031aa5fb1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695772941519"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695772941519"}]},"ts":"1695772941519"} 2023-09-27 00:02:21,519 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 37b68fc7a2afce55fcfb8fbe7bcd057f 2023-09-27 00:02:21,519 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=37b68fc7a2afce55fcfb8fbe7bcd057f, regionState=CLOSED 2023-09-27 00:02:21,519 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695772926143.37b68fc7a2afce55fcfb8fbe7bcd057f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695772941519"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695772941519"}]},"ts":"1695772941519"} 2023-09-27 00:02:21,522 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-09-27 00:02:21,522 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure e80833319d87b98c277e134031aa5fb1, server=jenkins-hbase9.apache.org,41869,1695772857056 in 172 msec 2023-09-27 00:02:21,523 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-09-27 00:02:21,523 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 37b68fc7a2afce55fcfb8fbe7bcd057f, server=jenkins-hbase9.apache.org,36739,1695772857140 in 173 msec 2023-09-27 00:02:21,523 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e80833319d87b98c277e134031aa5fb1, UNASSIGN in 178 msec 2023-09-27 00:02:21,524 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=86, resume processing ppid=84 2023-09-27 00:02:21,524 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=37b68fc7a2afce55fcfb8fbe7bcd057f, UNASSIGN in 179 msec 2023-09-27 00:02:21,525 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695772941525"}]},"ts":"1695772941525"} 2023-09-27 00:02:21,526 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-09-27 00:02:21,529 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-09-27 00:02:21,534 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 197 msec 2023-09-27 00:02:21,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-27 00:02:21,643 INFO [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-09-27 00:02:21,643 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:21,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:21,647 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:21,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:21,647 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:21,648 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41869] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:21,651 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:21,651 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:21,651 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:21,651 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:21,652 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e80833319d87b98c277e134031aa5fb1 2023-09-27 00:02:21,652 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/37b68fc7a2afce55fcfb8fbe7bcd057f 2023-09-27 00:02:21,652 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-27 00:02:21,652 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-27 00:02:21,652 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-27 00:02:21,652 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-27 00:02:21,653 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:21,653 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:21,653 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:02:21,653 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:21,653 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:21,653 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:02:21,653 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:02:21,653 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:02:21,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-27 00:02:21,654 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/37b68fc7a2afce55fcfb8fbe7bcd057f/cf, FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/37b68fc7a2afce55fcfb8fbe7bcd057f/recovered.edits] 2023-09-27 00:02:21,654 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e80833319d87b98c277e134031aa5fb1/cf, FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e80833319d87b98c277e134031aa5fb1/recovered.edits] 2023-09-27 00:02:21,658 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/37b68fc7a2afce55fcfb8fbe7bcd057f/cf/bc3544d1cbde4cd095ddcc82f37f4e74 to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/37b68fc7a2afce55fcfb8fbe7bcd057f/cf/bc3544d1cbde4cd095ddcc82f37f4e74 2023-09-27 00:02:21,658 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e80833319d87b98c277e134031aa5fb1/cf/e80ca1139a3040d1afc39aaacdfd3719 to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/e80833319d87b98c277e134031aa5fb1/cf/e80ca1139a3040d1afc39aaacdfd3719 2023-09-27 00:02:21,661 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/37b68fc7a2afce55fcfb8fbe7bcd057f/recovered.edits/9.seqid to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/37b68fc7a2afce55fcfb8fbe7bcd057f/recovered.edits/9.seqid 2023-09-27 00:02:21,661 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e80833319d87b98c277e134031aa5fb1/recovered.edits/9.seqid to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/e80833319d87b98c277e134031aa5fb1/recovered.edits/9.seqid 2023-09-27 00:02:21,661 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/37b68fc7a2afce55fcfb8fbe7bcd057f 2023-09-27 00:02:21,661 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e80833319d87b98c277e134031aa5fb1 2023-09-27 00:02:21,661 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-27 00:02:21,662 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-27 00:02:21,662 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-09-27 00:02:21,666 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230927924f9cbef0844dc1a0ecf5767efba7e5 to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230927924f9cbef0844dc1a0ecf5767efba7e5 2023-09-27 00:02:21,667 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023092701424e079dda46c99666af59598b5320 to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023092701424e079dda46c99666af59598b5320 2023-09-27 00:02:21,667 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-27 00:02:21,669 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:21,671 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-09-27 00:02:21,673 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-09-27 00:02:21,674 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:21,674 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-09-27 00:02:21,674 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695772926143.e80833319d87b98c277e134031aa5fb1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695772941674"}]},"ts":"9223372036854775807"} 2023-09-27 00:02:21,674 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695772926143.37b68fc7a2afce55fcfb8fbe7bcd057f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695772941674"}]},"ts":"9223372036854775807"} 2023-09-27 00:02:21,676 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-27 00:02:21,676 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e80833319d87b98c277e134031aa5fb1, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695772926143.e80833319d87b98c277e134031aa5fb1.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 37b68fc7a2afce55fcfb8fbe7bcd057f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695772926143.37b68fc7a2afce55fcfb8fbe7bcd057f.', STARTKEY => '1', ENDKEY => ''}] 2023-09-27 00:02:21,676 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-09-27 00:02:21,676 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695772941676"}]},"ts":"9223372036854775807"} 2023-09-27 00:02:21,677 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-09-27 00:02:21,681 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:21,682 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 37 msec 2023-09-27 00:02:21,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-27 00:02:21,755 INFO [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-09-27 00:02:21,764 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-27 00:02:21,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:21,768 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-27 00:02:21,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 00:02:21,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-09-27 00:02:21,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 00:02:21,796 INFO [Listener at jenkins-hbase9.apache.org/45033] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=760 (was 750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1356921685_1 at /127.0.0.1:54612 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x49a14021-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x49a14021-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x49a14021-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x49a14021-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3952 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-728144799_17 at /127.0.0.1:54628 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1988502388) connection to jenkins-hbase9.apache.org/172.31.2.10:38799 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x49a14021-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x49a14021-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-728144799_17 at /127.0.0.1:56062 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-728144799_17 at /127.0.0.1:53882 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1356921685_1 at /127.0.0.1:53852 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=911 (was 909) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=237 (was 220) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=6580 (was 6579) - AvailableMemoryMB LEAK? - 2023-09-27 00:02:21,796 WARN [Listener at jenkins-hbase9.apache.org/45033] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-09-27 00:02:21,816 INFO [Listener at jenkins-hbase9.apache.org/45033] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=760, OpenFileDescriptor=911, MaxFileDescriptor=60000, SystemLoadAverage=237, ProcessCount=168, AvailableMemoryMB=6580 2023-09-27 00:02:21,816 WARN [Listener at jenkins-hbase9.apache.org/45033] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-09-27 00:02:21,817 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-27 00:02:21,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-27 00:02:21,821 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-27 00:02:21,821 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-09-27 00:02:21,821 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-27 00:02:21,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-27 00:02:21,824 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testEmptyExportFileSystemState/2774a854ba825d4ae3d366c813a032a8 2023-09-27 00:02:21,824 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testEmptyExportFileSystemState/2e6097ce0f696a23687694deffa1a535 2023-09-27 00:02:21,824 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testEmptyExportFileSystemState/2774a854ba825d4ae3d366c813a032a8 empty. 2023-09-27 00:02:21,824 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testEmptyExportFileSystemState/2e6097ce0f696a23687694deffa1a535 empty. 2023-09-27 00:02:21,825 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testEmptyExportFileSystemState/2774a854ba825d4ae3d366c813a032a8 2023-09-27 00:02:21,825 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testEmptyExportFileSystemState/2e6097ce0f696a23687694deffa1a535 2023-09-27 00:02:21,825 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-27 00:02:21,833 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-27 00:02:21,835 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 2e6097ce0f696a23687694deffa1a535, NAME => 'testtb-testEmptyExportFileSystemState,1,1695772941817.2e6097ce0f696a23687694deffa1a535.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp 2023-09-27 00:02:21,835 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2774a854ba825d4ae3d366c813a032a8, NAME => 'testtb-testEmptyExportFileSystemState,,1695772941817.2774a854ba825d4ae3d366c813a032a8.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp 2023-09-27 00:02:21,842 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695772941817.2774a854ba825d4ae3d366c813a032a8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 00:02:21,842 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 2774a854ba825d4ae3d366c813a032a8, disabling compactions & flushes 2023-09-27 00:02:21,842 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695772941817.2e6097ce0f696a23687694deffa1a535.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 00:02:21,842 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695772941817.2774a854ba825d4ae3d366c813a032a8. 2023-09-27 00:02:21,842 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 2e6097ce0f696a23687694deffa1a535, disabling compactions & flushes 2023-09-27 00:02:21,842 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695772941817.2774a854ba825d4ae3d366c813a032a8. 2023-09-27 00:02:21,842 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695772941817.2e6097ce0f696a23687694deffa1a535. 2023-09-27 00:02:21,842 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695772941817.2e6097ce0f696a23687694deffa1a535. 2023-09-27 00:02:21,842 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695772941817.2774a854ba825d4ae3d366c813a032a8. after waiting 0 ms 2023-09-27 00:02:21,843 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695772941817.2e6097ce0f696a23687694deffa1a535. after waiting 0 ms 2023-09-27 00:02:21,843 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695772941817.2774a854ba825d4ae3d366c813a032a8. 2023-09-27 00:02:21,843 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695772941817.2e6097ce0f696a23687694deffa1a535. 2023-09-27 00:02:21,843 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695772941817.2774a854ba825d4ae3d366c813a032a8. 2023-09-27 00:02:21,843 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695772941817.2e6097ce0f696a23687694deffa1a535. 2023-09-27 00:02:21,843 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 2774a854ba825d4ae3d366c813a032a8: 2023-09-27 00:02:21,843 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 2e6097ce0f696a23687694deffa1a535: 2023-09-27 00:02:21,845 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-27 00:02:21,846 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695772941817.2774a854ba825d4ae3d366c813a032a8.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695772941846"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695772941846"}]},"ts":"1695772941846"} 2023-09-27 00:02:21,846 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695772941817.2e6097ce0f696a23687694deffa1a535.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695772941846"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695772941846"}]},"ts":"1695772941846"} 2023-09-27 00:02:21,848 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-27 00:02:21,849 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-27 00:02:21,849 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695772941849"}]},"ts":"1695772941849"} 2023-09-27 00:02:21,850 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-09-27 00:02:21,853 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-09-27 00:02:21,854 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 00:02:21,854 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 00:02:21,854 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 00:02:21,854 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 00:02:21,854 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2774a854ba825d4ae3d366c813a032a8, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2e6097ce0f696a23687694deffa1a535, ASSIGN}] 2023-09-27 00:02:21,857 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2774a854ba825d4ae3d366c813a032a8, ASSIGN 2023-09-27 00:02:21,857 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2e6097ce0f696a23687694deffa1a535, ASSIGN 2023-09-27 00:02:21,857 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2774a854ba825d4ae3d366c813a032a8, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,41869,1695772857056; forceNewPlan=false, retain=false 2023-09-27 00:02:21,857 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2e6097ce0f696a23687694deffa1a535, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,36739,1695772857140; forceNewPlan=false, retain=false 2023-09-27 00:02:21,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-27 00:02:22,008 INFO [jenkins-hbase9:33541] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-27 00:02:22,010 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=2e6097ce0f696a23687694deffa1a535, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:22,010 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=2774a854ba825d4ae3d366c813a032a8, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:22,011 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695772941817.2e6097ce0f696a23687694deffa1a535.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695772942010"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695772942010"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695772942010"}]},"ts":"1695772942010"} 2023-09-27 00:02:22,011 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695772941817.2774a854ba825d4ae3d366c813a032a8.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695772942010"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695772942010"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695772942010"}]},"ts":"1695772942010"} 2023-09-27 00:02:22,012 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 2e6097ce0f696a23687694deffa1a535, server=jenkins-hbase9.apache.org,36739,1695772857140}] 2023-09-27 00:02:22,013 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 2774a854ba825d4ae3d366c813a032a8, server=jenkins-hbase9.apache.org,41869,1695772857056}] 2023-09-27 00:02:22,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-27 00:02:22,167 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1695772941817.2774a854ba825d4ae3d366c813a032a8. 2023-09-27 00:02:22,167 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1695772941817.2e6097ce0f696a23687694deffa1a535. 2023-09-27 00:02:22,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2774a854ba825d4ae3d366c813a032a8, NAME => 'testtb-testEmptyExportFileSystemState,,1695772941817.2774a854ba825d4ae3d366c813a032a8.', STARTKEY => '', ENDKEY => '1'} 2023-09-27 00:02:22,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2e6097ce0f696a23687694deffa1a535, NAME => 'testtb-testEmptyExportFileSystemState,1,1695772941817.2e6097ce0f696a23687694deffa1a535.', STARTKEY => '1', ENDKEY => ''} 2023-09-27 00:02:22,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1695772941817.2e6097ce0f696a23687694deffa1a535. service=AccessControlService 2023-09-27 00:02:22,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1695772941817.2774a854ba825d4ae3d366c813a032a8. service=AccessControlService 2023-09-27 00:02:22,168 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 00:02:22,168 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 00:02:22,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 2e6097ce0f696a23687694deffa1a535 2023-09-27 00:02:22,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 2774a854ba825d4ae3d366c813a032a8 2023-09-27 00:02:22,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695772941817.2e6097ce0f696a23687694deffa1a535.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 00:02:22,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695772941817.2774a854ba825d4ae3d366c813a032a8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 00:02:22,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 2e6097ce0f696a23687694deffa1a535 2023-09-27 00:02:22,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 2774a854ba825d4ae3d366c813a032a8 2023-09-27 00:02:22,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 2e6097ce0f696a23687694deffa1a535 2023-09-27 00:02:22,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 2774a854ba825d4ae3d366c813a032a8 2023-09-27 00:02:22,169 INFO [StoreOpener-2774a854ba825d4ae3d366c813a032a8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2774a854ba825d4ae3d366c813a032a8 2023-09-27 00:02:22,169 INFO [StoreOpener-2e6097ce0f696a23687694deffa1a535-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2e6097ce0f696a23687694deffa1a535 2023-09-27 00:02:22,170 DEBUG [StoreOpener-2e6097ce0f696a23687694deffa1a535-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testEmptyExportFileSystemState/2e6097ce0f696a23687694deffa1a535/cf 2023-09-27 00:02:22,170 DEBUG [StoreOpener-2774a854ba825d4ae3d366c813a032a8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testEmptyExportFileSystemState/2774a854ba825d4ae3d366c813a032a8/cf 2023-09-27 00:02:22,170 DEBUG [StoreOpener-2e6097ce0f696a23687694deffa1a535-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testEmptyExportFileSystemState/2e6097ce0f696a23687694deffa1a535/cf 2023-09-27 00:02:22,170 DEBUG [StoreOpener-2774a854ba825d4ae3d366c813a032a8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testEmptyExportFileSystemState/2774a854ba825d4ae3d366c813a032a8/cf 2023-09-27 00:02:22,171 INFO [StoreOpener-2774a854ba825d4ae3d366c813a032a8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2774a854ba825d4ae3d366c813a032a8 columnFamilyName cf 2023-09-27 00:02:22,171 INFO [StoreOpener-2e6097ce0f696a23687694deffa1a535-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2e6097ce0f696a23687694deffa1a535 columnFamilyName cf 2023-09-27 00:02:22,172 INFO [StoreOpener-2774a854ba825d4ae3d366c813a032a8-1] regionserver.HStore(310): Store=2774a854ba825d4ae3d366c813a032a8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 00:02:22,172 INFO [StoreOpener-2e6097ce0f696a23687694deffa1a535-1] regionserver.HStore(310): Store=2e6097ce0f696a23687694deffa1a535/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 00:02:22,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testEmptyExportFileSystemState/2774a854ba825d4ae3d366c813a032a8 2023-09-27 00:02:22,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testEmptyExportFileSystemState/2e6097ce0f696a23687694deffa1a535 2023-09-27 00:02:22,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testEmptyExportFileSystemState/2774a854ba825d4ae3d366c813a032a8 2023-09-27 00:02:22,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testEmptyExportFileSystemState/2e6097ce0f696a23687694deffa1a535 2023-09-27 00:02:22,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 2774a854ba825d4ae3d366c813a032a8 2023-09-27 00:02:22,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 2e6097ce0f696a23687694deffa1a535 2023-09-27 00:02:22,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testEmptyExportFileSystemState/2774a854ba825d4ae3d366c813a032a8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 00:02:22,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testEmptyExportFileSystemState/2e6097ce0f696a23687694deffa1a535/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 00:02:22,178 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 2774a854ba825d4ae3d366c813a032a8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63461629, jitterRate=-0.05434803664684296}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 00:02:22,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 2774a854ba825d4ae3d366c813a032a8: 2023-09-27 00:02:22,178 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 2e6097ce0f696a23687694deffa1a535; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74055326, jitterRate=0.10351034998893738}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 00:02:22,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 2e6097ce0f696a23687694deffa1a535: 2023-09-27 00:02:22,179 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1695772941817.2e6097ce0f696a23687694deffa1a535., pid=93, masterSystemTime=1695772942164 2023-09-27 00:02:22,179 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1695772941817.2774a854ba825d4ae3d366c813a032a8., pid=94, masterSystemTime=1695772942164 2023-09-27 00:02:22,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1695772941817.2e6097ce0f696a23687694deffa1a535. 2023-09-27 00:02:22,180 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1695772941817.2e6097ce0f696a23687694deffa1a535. 2023-09-27 00:02:22,180 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=2e6097ce0f696a23687694deffa1a535, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:22,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1695772941817.2774a854ba825d4ae3d366c813a032a8. 2023-09-27 00:02:22,181 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1695772941817.2774a854ba825d4ae3d366c813a032a8. 2023-09-27 00:02:22,181 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1695772941817.2e6097ce0f696a23687694deffa1a535.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695772942180"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695772942180"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695772942180"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695772942180"}]},"ts":"1695772942180"} 2023-09-27 00:02:22,181 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=2774a854ba825d4ae3d366c813a032a8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:22,181 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1695772941817.2774a854ba825d4ae3d366c813a032a8.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695772942181"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695772942181"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695772942181"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695772942181"}]},"ts":"1695772942181"} 2023-09-27 00:02:22,183 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=92 2023-09-27 00:02:22,184 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 2e6097ce0f696a23687694deffa1a535, server=jenkins-hbase9.apache.org,36739,1695772857140 in 170 msec 2023-09-27 00:02:22,184 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=91 2023-09-27 00:02:22,184 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 2774a854ba825d4ae3d366c813a032a8, server=jenkins-hbase9.apache.org,41869,1695772857056 in 170 msec 2023-09-27 00:02:22,184 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2e6097ce0f696a23687694deffa1a535, ASSIGN in 329 msec 2023-09-27 00:02:22,186 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=91, resume processing ppid=90 2023-09-27 00:02:22,186 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2774a854ba825d4ae3d366c813a032a8, ASSIGN in 330 msec 2023-09-27 00:02:22,186 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-27 00:02:22,186 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695772942186"}]},"ts":"1695772942186"} 2023-09-27 00:02:22,187 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-09-27 00:02:22,189 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-27 00:02:22,190 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-09-27 00:02:22,191 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41869] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-27 00:02:22,193 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:02:22,193 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:02:22,193 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:02:22,193 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:02:22,195 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-27 00:02:22,195 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-27 00:02:22,195 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-27 00:02:22,195 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-27 00:02:22,196 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 377 msec 2023-09-27 00:02:22,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-27 00:02:22,426 INFO [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-09-27 00:02:22,428 DEBUG [Listener at jenkins-hbase9.apache.org/45033] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-27 00:02:22,428 DEBUG [Listener at jenkins-hbase9.apache.org/45033] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695772941817.2774a854ba825d4ae3d366c813a032a8. 2023-09-27 00:02:22,430 INFO [Listener at jenkins-hbase9.apache.org/45033] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 00:02:22,440 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 00:02:22,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695772942440 (current time:1695772942440). 2023-09-27 00:02:22,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 00:02:22,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(139): Connect 0x492d2eb3 to 127.0.0.1:57983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 00:02:22,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@242a5129, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 00:02:22,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 00:02:22,454 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:50940, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 00:02:22,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x492d2eb3 to 127.0.0.1:57983 2023-09-27 00:02:22,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 00:02:22,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(139): Connect 0x4688b8b8 to 127.0.0.1:57983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 00:02:22,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66704e6c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 00:02:22,466 DEBUG [hconnection-0x1025f892-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 00:02:22,467 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:50956, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 00:02:22,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4688b8b8 to 127.0.0.1:57983 2023-09-27 00:02:22,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 00:02:22,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-27 00:02:22,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 00:02:22,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 00:02:22,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-27 00:02:22,477 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-27 00:02:22,477 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695773542477 2023-09-27 00:02:22,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 00:02:22,477 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-27 00:02:22,479 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 00:02:22,479 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 00:02:22,480 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-27 00:02:22,481 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-27 00:02:22,481 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-09-27 00:02:22,485 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-27 00:02:22,485 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695773542485 2023-09-27 00:02:22,499 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,500 INFO [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-09-27 00:02:22,500 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:02:22,501 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-27 00:02:22,501 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-27 00:02:22,502 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,502 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,508 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:02:22,508 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:22,508 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:02:22,508 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:02:22,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:02:22,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:02:22,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:02:22,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:02:22,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:02:22,508 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:22,508 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:22,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:02:22,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,508 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:22,508 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 00:02:22,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,509 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,509 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,509 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-27 00:02:22,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-27 00:02:22,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-27 00:02:22,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,509 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-27 00:02:22,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,509 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-27 00:02:22,509 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-27 00:02:22,509 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,509 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-27 00:02:22,510 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,509 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,510 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-27 00:02:22,510 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-27 00:02:22,510 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:02:22,510 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:02:22,511 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-27 00:02:22,511 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-27 00:02:22,512 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41869,1695772857056' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-27 00:02:22,510 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:02:22,512 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-27 00:02:22,513 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-27 00:02:22,513 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-27 00:02:22,513 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-27 00:02:22,513 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,36739,1695772857140' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-27 00:02:22,513 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41703,1695772857103' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-27 00:02:22,515 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:22,515 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:22,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:02:22,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:02:22,515 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,515 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:02:22,516 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,516 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 00:02:22,515 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:22,516 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,516 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 00:02:22,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:02:22,516 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,516 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 00:02:22,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:22,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:22,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:22,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:02:22,517 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,41869,1695772857056' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-27 00:02:22,517 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70fcfafe[Count = 1] remaining members to acquire global barrier 2023-09-27 00:02:22,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:22,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:02:22,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:02:22,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:02:22,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:02:22,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:22,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:22,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:22,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:02:22,520 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,36739,1695772857140' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-27 00:02:22,520 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70fcfafe[Count = 0] remaining members to acquire global barrier 2023-09-27 00:02:22,520 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-27 00:02:22,520 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,521 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,521 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,521 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,521 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-27 00:02:22,521 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-27 00:02:22,521 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:22,522 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-27 00:02:22,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,522 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,41703,1695772857103' in zk 2023-09-27 00:02:22,522 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-27 00:02:22,522 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 00:02:22,522 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 00:02:22,522 DEBUG [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695772941817.2774a854ba825d4ae3d366c813a032a8. 2023-09-27 00:02:22,522 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:22,522 DEBUG [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695772941817.2774a854ba825d4ae3d366c813a032a8. started... 2023-09-27 00:02:22,522 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 00:02:22,522 DEBUG [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2774a854ba825d4ae3d366c813a032a8: 2023-09-27 00:02:22,522 DEBUG [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695772941817.2774a854ba825d4ae3d366c813a032a8.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,523 DEBUG [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 00:02:22,523 DEBUG [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 00:02:22,523 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 00:02:22,523 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 00:02:22,523 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695772941817.2e6097ce0f696a23687694deffa1a535. 2023-09-27 00:02:22,523 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695772941817.2e6097ce0f696a23687694deffa1a535. started... 2023-09-27 00:02:22,525 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2e6097ce0f696a23687694deffa1a535: 2023-09-27 00:02:22,525 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-27 00:02:22,525 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695772941817.2e6097ce0f696a23687694deffa1a535.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,525 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:02:22,525 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 00:02:22,525 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-27 00:02:22,526 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 00:02:22,542 DEBUG [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695772941817.2774a854ba825d4ae3d366c813a032a8. completed. 2023-09-27 00:02:22,543 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695772941817.2e6097ce0f696a23687694deffa1a535. completed. 2023-09-27 00:02:22,543 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695772941817.2e6097ce0f696a23687694deffa1a535. 2023-09-27 00:02:22,543 DEBUG [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695772941817.2774a854ba825d4ae3d366c813a032a8. 2023-09-27 00:02:22,543 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 00:02:22,543 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 00:02:22,543 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:22,543 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 00:02:22,543 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 00:02:22,543 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-27 00:02:22,543 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:22,543 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,36739,1695772857140' in zk 2023-09-27 00:02:22,543 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-27 00:02:22,543 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,41869,1695772857056' in zk 2023-09-27 00:02:22,545 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:22,545 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-27 00:02:22,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:22,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:02:22,545 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-27 00:02:22,545 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:02:22,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:02:22,545 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-27 00:02:22,545 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:02:22,545 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:22,547 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-27 00:02:22,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:02:22,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:02:22,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:22,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:22,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:22,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:02:22,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:22,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:22,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:22,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,41869,1695772857056': 2023-09-27 00:02:22,551 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,41869,1695772857056' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-27 00:02:22,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:22,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:02:22,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:02:22,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:02:22,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:02:22,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:22,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:22,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:22,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:02:22,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:22,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:22,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:22,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,36739,1695772857140': 2023-09-27 00:02:22,554 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,36739,1695772857140' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-27 00:02:22,554 INFO [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-09-27 00:02:22,554 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 00:02:22,554 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 00:02:22,554 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,554 INFO [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 00:02:22,556 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,556 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,556 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,556 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:02:22,556 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:02:22,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:02:22,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:02:22,556 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:02:22,556 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:02:22,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:02:22,556 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:22,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:02:22,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:02:22,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:02:22,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:02:22,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:02:22,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,559 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:22,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,559 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:22,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:02:22,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:22,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:22,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:22,561 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:22,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:02:22,561 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:22,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,561 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:22,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:22,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:22,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:22,564 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:02:22,564 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:22,564 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:02:22,564 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,564 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:02:22,564 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:22,564 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:02:22,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:02:22,564 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:02:22,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:02:22,564 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:22,564 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:02:22,565 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-27 00:02:22,564 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:02:22,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:02:22,565 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:02:22,566 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 00:02:22,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:02:22,565 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:02:22,565 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:02:22,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:02:22,566 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:22,567 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,567 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:22,567 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:22,567 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:02:22,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:02:22,567 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:02:22,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:02:22,567 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-27 00:02:22,574 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,574 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,579 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 00:02:22,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-27 00:02:22,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-27 00:02:22,581 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 00:02:22,592 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,592 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-27 00:02:22,592 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,593 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,593 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695772942478Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695772942574 (+96 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695772942574Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1695772942574Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1695772942577 (+3 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695772942584 (+7 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695772942592 (+8 ms) 2023-09-27 00:02:22,596 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-27 00:02:22,597 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 117 msec 2023-09-27 00:02:22,613 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-27 00:02:22,781 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 00:02:22,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-27 00:02:22,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 00:02:22,784 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41869] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1695772941817.2774a854ba825d4ae3d366c813a032a8. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 00:02:22,785 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36739] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1695772941817.2e6097ce0f696a23687694deffa1a535. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 00:02:22,787 DEBUG [Listener at jenkins-hbase9.apache.org/45033] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-27 00:02:22,787 DEBUG [Listener at jenkins-hbase9.apache.org/45033] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695772941817.2774a854ba825d4ae3d366c813a032a8. 2023-09-27 00:02:22,787 INFO [Listener at jenkins-hbase9.apache.org/45033] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 00:02:22,796 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 00:02:22,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695772942796 (current time:1695772942796). 2023-09-27 00:02:22,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 00:02:22,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(139): Connect 0x3d4d60b3 to 127.0.0.1:57983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 00:02:22,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@213eee0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 00:02:22,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 00:02:22,808 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:50972, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 00:02:22,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3d4d60b3 to 127.0.0.1:57983 2023-09-27 00:02:22,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 00:02:22,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(139): Connect 0x70db8519 to 127.0.0.1:57983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 00:02:22,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@26c53b49, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 00:02:22,816 DEBUG [hconnection-0x3bbcb59f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 00:02:22,819 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:50988, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 00:02:22,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x70db8519 to 127.0.0.1:57983 2023-09-27 00:02:22,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 00:02:22,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-27 00:02:22,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 00:02:22,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 00:02:22,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-27 00:02:22,827 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-27 00:02:22,828 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695773542828 2023-09-27 00:02:22,828 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-27 00:02:22,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 00:02:22,829 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 00:02:22,829 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 00:02:22,830 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-27 00:02:22,831 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-27 00:02:22,832 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-09-27 00:02:22,833 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-27 00:02:22,833 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695773542833 2023-09-27 00:02:22,844 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,844 INFO [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-09-27 00:02:22,844 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:02:22,845 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-27 00:02:22,845 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-27 00:02:22,846 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,846 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,848 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:02:22,848 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:22,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:02:22,848 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:02:22,848 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:02:22,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:02:22,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:02:22,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:02:22,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:02:22,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:02:22,849 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:22,849 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:22,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,849 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:22,849 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 00:02:22,849 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,849 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,849 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-27 00:02:22,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-27 00:02:22,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-27 00:02:22,850 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-27 00:02:22,850 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-27 00:02:22,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,850 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,850 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-27 00:02:22,850 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,850 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-27 00:02:22,850 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-27 00:02:22,850 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:02:22,850 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,850 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:02:22,851 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-27 00:02:22,852 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-27 00:02:22,852 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-27 00:02:22,852 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,36739,1695772857140' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-27 00:02:22,851 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-27 00:02:22,853 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-27 00:02:22,852 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:02:22,853 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41703,1695772857103' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-27 00:02:22,856 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-27 00:02:22,856 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-27 00:02:22,856 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41869,1695772857056' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-27 00:02:22,858 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,858 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:22,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:22,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:02:22,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:02:22,859 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,859 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:22,859 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,859 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 00:02:22,859 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:02:22,859 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,859 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 00:02:22,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:02:22,859 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,859 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 00:02:22,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:22,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:22,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:22,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:02:22,861 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,36739,1695772857140' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-27 00:02:22,861 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5782ce69[Count = 1] remaining members to acquire global barrier 2023-09-27 00:02:22,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:22,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:02:22,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:02:22,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:02:22,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:02:22,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:22,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:22,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:22,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:02:22,862 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,41869,1695772857056' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-27 00:02:22,862 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5782ce69[Count = 0] remaining members to acquire global barrier 2023-09-27 00:02:22,862 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-27 00:02:22,862 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,867 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,867 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,867 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,867 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:22,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,867 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-27 00:02:22,867 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-27 00:02:22,867 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-27 00:02:22,868 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:22,868 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,41703,1695772857103' in zk 2023-09-27 00:02:22,868 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 00:02:22,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,868 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695772941817.2e6097ce0f696a23687694deffa1a535. 2023-09-27 00:02:22,868 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-27 00:02:22,868 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695772941817.2e6097ce0f696a23687694deffa1a535. started... 2023-09-27 00:02:22,868 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 00:02:22,868 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 00:02:22,868 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 00:02:22,868 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 00:02:22,868 DEBUG [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695772941817.2774a854ba825d4ae3d366c813a032a8. 2023-09-27 00:02:22,868 DEBUG [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695772941817.2774a854ba825d4ae3d366c813a032a8. started... 2023-09-27 00:02:22,868 INFO [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2e6097ce0f696a23687694deffa1a535 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-27 00:02:22,868 INFO [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2774a854ba825d4ae3d366c813a032a8 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-27 00:02:22,869 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-27 00:02:22,869 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:02:22,869 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-27 00:02:22,891 INFO [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023092714b292a814f847d89e788613d889c32a to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023092714b292a814f847d89e788613d889c32a 2023-09-27 00:02:22,891 INFO [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230927f9a33aacb2f741a0a7a8ccbad27253a9 to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230927f9a33aacb2f741a0a7a8ccbad27253a9 2023-09-27 00:02:22,898 INFO [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testEmptyExportFileSystemState/2e6097ce0f696a23687694deffa1a535/.tmp/cf/de0f44e0945146d58e2f0ed03a868173 2023-09-27 00:02:22,899 INFO [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testEmptyExportFileSystemState/2774a854ba825d4ae3d366c813a032a8/.tmp/cf/79445c2ae04b4dcf83f14aa8c4eedbbf 2023-09-27 00:02:22,903 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testEmptyExportFileSystemState/2e6097ce0f696a23687694deffa1a535/.tmp/cf/de0f44e0945146d58e2f0ed03a868173 as hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testEmptyExportFileSystemState/2e6097ce0f696a23687694deffa1a535/cf/de0f44e0945146d58e2f0ed03a868173 2023-09-27 00:02:22,904 DEBUG [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testEmptyExportFileSystemState/2774a854ba825d4ae3d366c813a032a8/.tmp/cf/79445c2ae04b4dcf83f14aa8c4eedbbf as hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testEmptyExportFileSystemState/2774a854ba825d4ae3d366c813a032a8/cf/79445c2ae04b4dcf83f14aa8c4eedbbf 2023-09-27 00:02:22,908 INFO [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testEmptyExportFileSystemState/2e6097ce0f696a23687694deffa1a535/cf/de0f44e0945146d58e2f0ed03a868173, entries=47, sequenceid=6, filesize=13.1 K 2023-09-27 00:02:22,909 INFO [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testEmptyExportFileSystemState/2774a854ba825d4ae3d366c813a032a8/cf/79445c2ae04b4dcf83f14aa8c4eedbbf, entries=3, sequenceid=6, filesize=5.4 K 2023-09-27 00:02:22,909 INFO [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 2e6097ce0f696a23687694deffa1a535 in 41ms, sequenceid=6, compaction requested=false 2023-09-27 00:02:22,911 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2e6097ce0f696a23687694deffa1a535: 2023-09-27 00:02:22,911 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695772941817.2e6097ce0f696a23687694deffa1a535.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,911 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 00:02:22,911 INFO [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 2774a854ba825d4ae3d366c813a032a8 in 43ms, sequenceid=6, compaction requested=false 2023-09-27 00:02:22,911 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testEmptyExportFileSystemState/2e6097ce0f696a23687694deffa1a535/cf/de0f44e0945146d58e2f0ed03a868173] hfiles 2023-09-27 00:02:22,911 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testEmptyExportFileSystemState/2e6097ce0f696a23687694deffa1a535/cf/de0f44e0945146d58e2f0ed03a868173 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,911 DEBUG [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2774a854ba825d4ae3d366c813a032a8: 2023-09-27 00:02:22,911 DEBUG [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695772941817.2774a854ba825d4ae3d366c813a032a8.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,913 DEBUG [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 00:02:22,913 DEBUG [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testEmptyExportFileSystemState/2774a854ba825d4ae3d366c813a032a8/cf/79445c2ae04b4dcf83f14aa8c4eedbbf] hfiles 2023-09-27 00:02:22,913 DEBUG [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testEmptyExportFileSystemState/2774a854ba825d4ae3d366c813a032a8/cf/79445c2ae04b4dcf83f14aa8c4eedbbf for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,920 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695772941817.2e6097ce0f696a23687694deffa1a535. completed. 2023-09-27 00:02:22,920 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695772941817.2e6097ce0f696a23687694deffa1a535. 2023-09-27 00:02:22,920 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 00:02:22,920 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 00:02:22,920 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:22,920 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-27 00:02:22,920 DEBUG [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695772941817.2774a854ba825d4ae3d366c813a032a8. completed. 2023-09-27 00:02:22,920 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,36739,1695772857140' in zk 2023-09-27 00:02:22,920 DEBUG [rs(jenkins-hbase9.apache.org,41869,1695772857056)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695772941817.2774a854ba825d4ae3d366c813a032a8. 2023-09-27 00:02:22,920 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 00:02:22,921 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 00:02:22,921 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:22,921 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-27 00:02:22,921 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,41869,1695772857056' in zk 2023-09-27 00:02:22,922 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:22,922 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-27 00:02:22,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:22,923 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:02:22,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:02:22,923 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-27 00:02:22,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:02:22,924 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:22,924 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-27 00:02:22,924 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:02:22,924 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-27 00:02:22,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:02:22,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:02:22,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:22,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:22,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:22,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:02:22,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:22,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:22,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:22,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,36739,1695772857140': 2023-09-27 00:02:22,928 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,36739,1695772857140' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-27 00:02:22,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:22,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:02:22,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:02:22,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:02:22,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:02:22,929 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 00:02:22,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:22,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:22,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-27 00:02:22,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:22,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-27 00:02:22,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:02:22,930 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 00:02:22,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:22,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:22,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:22,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,41869,1695772857056': 2023-09-27 00:02:22,932 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,41869,1695772857056' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-27 00:02:22,932 INFO [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-09-27 00:02:22,932 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 00:02:22,932 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 00:02:22,932 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,932 INFO [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 00:02:22,935 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,935 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:02:22,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,935 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:02:22,935 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,935 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,936 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:02:22,936 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:02:22,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:02:22,936 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:22,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:02:22,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:02:22,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:02:22,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:02:22,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:02:22,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:02:22,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:02:22,936 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:22,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,937 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:22,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:02:22,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:22,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:22,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:22,938 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:22,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:02:22,938 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:22,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,939 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:22,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:22,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:22,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:22,941 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:22,941 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,941 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:02:22,941 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:02:22,941 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:02:22,941 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:22,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:02:22,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:02:22,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:02:22,941 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:02:22,941 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-27 00:02:22,941 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:02:22,941 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:22,941 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:02:22,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:02:22,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:02:22,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:02:22,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:02:22,941 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:02:22,941 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,941 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:02:22,942 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 00:02:22,941 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:02:22,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:02:22,942 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:22,943 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,943 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:22,943 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:22,943 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,943 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:02:22,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:02:22,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023092714b292a814f847d89e788613d889c32a, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230927f9a33aacb2f741a0a7a8ccbad27253a9] mob files 2023-09-27 00:02:22,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023092714b292a814f847d89e788613d889c32a 2023-09-27 00:02:22,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230927f9a33aacb2f741a0a7a8ccbad27253a9 2023-09-27 00:02:22,950 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,951 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,967 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,968 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-27 00:02:22,968 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,968 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:22,968 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695772942828Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695772942950 (+122 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1695772942950Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1695772942950Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1695772942954 (+4 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1695772942961 (+7 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695772942968 (+7 ms) 2023-09-27 00:02:22,973 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-27 00:02:22,974 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 144 msec 2023-09-27 00:02:23,131 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 00:02:23,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-27 00:02:23,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 00:02:23,132 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772943132 2023-09-27 00:02:23,132 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40313, tgtDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772943132, rawTgtDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772943132, srcFsUri=hdfs://localhost:40313, srcDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8 2023-09-27 00:02:23,153 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40313, inputRoot=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8 2023-09-27 00:02:23,154 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-157817513_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772943132, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772943132/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:23,154 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40313, inputRoot=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8, snapshotDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-09-27 00:02:23,159 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772943132/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:23,184 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-27 00:02:23,184 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-27 00:02:23,184 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-27 00:02:23,185 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-27 00:02:24,055 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/hadoop-7547596610366161140.jar 2023-09-27 00:02:24,056 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-27 00:02:24,056 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-27 00:02:24,120 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/hadoop-8422699878063906739.jar 2023-09-27 00:02:24,121 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-27 00:02:24,121 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-27 00:02:24,121 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-27 00:02:24,122 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-27 00:02:24,122 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-27 00:02:24,122 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-27 00:02:24,122 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-27 00:02:24,123 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-27 00:02:24,123 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-27 00:02:24,123 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-27 00:02:24,124 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-27 00:02:24,124 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-27 00:02:24,125 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-27 00:02:24,125 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-27 00:02:24,125 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-27 00:02:24,126 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-27 00:02:24,126 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 00:02:24,126 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 00:02:24,127 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 00:02:24,127 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 00:02:24,127 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 00:02:24,128 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 00:02:24,128 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 00:02:24,475 WARN [Listener at jenkins-hbase9.apache.org/45033] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-27 00:02:24,478 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-09-27 00:02:25,412 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 00:02:25,412 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 00:02:25,414 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695772863328_0005_000001 (auth:SIMPLE) 2023-09-27 00:02:26,100 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695772863328_0006_000001 (auth:SIMPLE) 2023-09-27 00:02:26,677 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-27 00:02:29,906 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695772863328_0006_000001 (auth:SIMPLE) 2023-09-27 00:02:32,815 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-27 00:02:32,816 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-27 00:02:32,823 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:32,824 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-27 00:02:32,824 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-27 00:02:32,824 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-728144799_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:32,825 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(367): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-27 00:02:32,825 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(367): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-27 00:02:32,825 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-728144799_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772943132/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772943132/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:32,825 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(367): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772943132/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-27 00:02:32,825 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(367): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772943132/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-27 00:02:32,834 INFO [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-09-27 00:02:32,834 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testEmptyExportFileSystemState 2023-09-27 00:02:32,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-27 00:02:32,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-27 00:02:32,839 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695772952839"}]},"ts":"1695772952839"} 2023-09-27 00:02:32,840 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-09-27 00:02:32,843 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-09-27 00:02:32,843 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2774a854ba825d4ae3d366c813a032a8, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2e6097ce0f696a23687694deffa1a535, UNASSIGN}] 2023-09-27 00:02:32,846 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2774a854ba825d4ae3d366c813a032a8, UNASSIGN 2023-09-27 00:02:32,846 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2e6097ce0f696a23687694deffa1a535, UNASSIGN 2023-09-27 00:02:32,846 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=2774a854ba825d4ae3d366c813a032a8, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:32,846 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=2e6097ce0f696a23687694deffa1a535, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:32,846 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695772941817.2774a854ba825d4ae3d366c813a032a8.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695772952846"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695772952846"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695772952846"}]},"ts":"1695772952846"} 2023-09-27 00:02:32,846 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695772941817.2e6097ce0f696a23687694deffa1a535.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695772952846"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695772952846"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695772952846"}]},"ts":"1695772952846"} 2023-09-27 00:02:32,848 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 2774a854ba825d4ae3d366c813a032a8, server=jenkins-hbase9.apache.org,41869,1695772857056}] 2023-09-27 00:02:32,848 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 2e6097ce0f696a23687694deffa1a535, server=jenkins-hbase9.apache.org,36739,1695772857140}] 2023-09-27 00:02:32,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-27 00:02:33,000 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 2774a854ba825d4ae3d366c813a032a8 2023-09-27 00:02:33,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 2774a854ba825d4ae3d366c813a032a8, disabling compactions & flushes 2023-09-27 00:02:33,000 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695772941817.2774a854ba825d4ae3d366c813a032a8. 2023-09-27 00:02:33,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695772941817.2774a854ba825d4ae3d366c813a032a8. 2023-09-27 00:02:33,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695772941817.2774a854ba825d4ae3d366c813a032a8. after waiting 0 ms 2023-09-27 00:02:33,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695772941817.2774a854ba825d4ae3d366c813a032a8. 2023-09-27 00:02:33,001 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 2e6097ce0f696a23687694deffa1a535 2023-09-27 00:02:33,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 2e6097ce0f696a23687694deffa1a535, disabling compactions & flushes 2023-09-27 00:02:33,004 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695772941817.2e6097ce0f696a23687694deffa1a535. 2023-09-27 00:02:33,004 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695772941817.2e6097ce0f696a23687694deffa1a535. 2023-09-27 00:02:33,004 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695772941817.2e6097ce0f696a23687694deffa1a535. after waiting 0 ms 2023-09-27 00:02:33,004 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695772941817.2e6097ce0f696a23687694deffa1a535. 2023-09-27 00:02:33,009 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testEmptyExportFileSystemState/2e6097ce0f696a23687694deffa1a535/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 00:02:33,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testEmptyExportFileSystemState/2774a854ba825d4ae3d366c813a032a8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 00:02:33,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 00:02:33,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 00:02:33,011 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695772941817.2e6097ce0f696a23687694deffa1a535. 2023-09-27 00:02:33,012 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695772941817.2774a854ba825d4ae3d366c813a032a8. 2023-09-27 00:02:33,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 2e6097ce0f696a23687694deffa1a535: 2023-09-27 00:02:33,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 2774a854ba825d4ae3d366c813a032a8: 2023-09-27 00:02:33,013 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 2e6097ce0f696a23687694deffa1a535 2023-09-27 00:02:33,014 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=2e6097ce0f696a23687694deffa1a535, regionState=CLOSED 2023-09-27 00:02:33,014 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695772941817.2e6097ce0f696a23687694deffa1a535.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695772953014"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695772953014"}]},"ts":"1695772953014"} 2023-09-27 00:02:33,014 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 2774a854ba825d4ae3d366c813a032a8 2023-09-27 00:02:33,014 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=2774a854ba825d4ae3d366c813a032a8, regionState=CLOSED 2023-09-27 00:02:33,014 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695772941817.2774a854ba825d4ae3d366c813a032a8.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695772953014"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695772953014"}]},"ts":"1695772953014"} 2023-09-27 00:02:33,017 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=101 2023-09-27 00:02:33,017 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 2e6097ce0f696a23687694deffa1a535, server=jenkins-hbase9.apache.org,36739,1695772857140 in 167 msec 2023-09-27 00:02:33,017 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-09-27 00:02:33,017 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 2774a854ba825d4ae3d366c813a032a8, server=jenkins-hbase9.apache.org,41869,1695772857056 in 168 msec 2023-09-27 00:02:33,018 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2e6097ce0f696a23687694deffa1a535, UNASSIGN in 174 msec 2023-09-27 00:02:33,018 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=100, resume processing ppid=99 2023-09-27 00:02:33,018 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2774a854ba825d4ae3d366c813a032a8, UNASSIGN in 174 msec 2023-09-27 00:02:33,019 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695772953019"}]},"ts":"1695772953019"} 2023-09-27 00:02:33,020 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-09-27 00:02:33,022 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-09-27 00:02:33,023 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 188 msec 2023-09-27 00:02:33,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-27 00:02:33,141 INFO [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-09-27 00:02:33,142 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testEmptyExportFileSystemState 2023-09-27 00:02:33,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-27 00:02:33,145 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-27 00:02:33,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-09-27 00:02:33,146 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-27 00:02:33,147 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41869] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-09-27 00:02:33,149 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testEmptyExportFileSystemState/2774a854ba825d4ae3d366c813a032a8 2023-09-27 00:02:33,149 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testEmptyExportFileSystemState/2e6097ce0f696a23687694deffa1a535 2023-09-27 00:02:33,150 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-27 00:02:33,150 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-27 00:02:33,150 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-27 00:02:33,150 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-27 00:02:33,150 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-27 00:02:33,150 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-27 00:02:33,150 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-27 00:02:33,150 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-27 00:02:33,152 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testEmptyExportFileSystemState/2774a854ba825d4ae3d366c813a032a8/cf, FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testEmptyExportFileSystemState/2774a854ba825d4ae3d366c813a032a8/recovered.edits] 2023-09-27 00:02:33,152 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testEmptyExportFileSystemState/2e6097ce0f696a23687694deffa1a535/cf, FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testEmptyExportFileSystemState/2e6097ce0f696a23687694deffa1a535/recovered.edits] 2023-09-27 00:02:33,152 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-27 00:02:33,152 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-27 00:02:33,152 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:02:33,153 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:02:33,153 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-27 00:02:33,153 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:02:33,152 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-27 00:02:33,153 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:02:33,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-27 00:02:33,161 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testEmptyExportFileSystemState/2e6097ce0f696a23687694deffa1a535/cf/de0f44e0945146d58e2f0ed03a868173 to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/archive/data/default/testtb-testEmptyExportFileSystemState/2e6097ce0f696a23687694deffa1a535/cf/de0f44e0945146d58e2f0ed03a868173 2023-09-27 00:02:33,161 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testEmptyExportFileSystemState/2774a854ba825d4ae3d366c813a032a8/cf/79445c2ae04b4dcf83f14aa8c4eedbbf to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/archive/data/default/testtb-testEmptyExportFileSystemState/2774a854ba825d4ae3d366c813a032a8/cf/79445c2ae04b4dcf83f14aa8c4eedbbf 2023-09-27 00:02:33,164 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testEmptyExportFileSystemState/2e6097ce0f696a23687694deffa1a535/recovered.edits/9.seqid to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/archive/data/default/testtb-testEmptyExportFileSystemState/2e6097ce0f696a23687694deffa1a535/recovered.edits/9.seqid 2023-09-27 00:02:33,164 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testEmptyExportFileSystemState/2774a854ba825d4ae3d366c813a032a8/recovered.edits/9.seqid to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/archive/data/default/testtb-testEmptyExportFileSystemState/2774a854ba825d4ae3d366c813a032a8/recovered.edits/9.seqid 2023-09-27 00:02:33,165 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testEmptyExportFileSystemState/2e6097ce0f696a23687694deffa1a535 2023-09-27 00:02:33,165 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testEmptyExportFileSystemState/2774a854ba825d4ae3d366c813a032a8 2023-09-27 00:02:33,165 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-27 00:02:33,165 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-27 00:02:33,166 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-09-27 00:02:33,169 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023092714b292a814f847d89e788613d889c32a to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023092714b292a814f847d89e788613d889c32a 2023-09-27 00:02:33,170 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230927f9a33aacb2f741a0a7a8ccbad27253a9 to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230927f9a33aacb2f741a0a7a8ccbad27253a9 2023-09-27 00:02:33,171 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-27 00:02:33,173 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-27 00:02:33,175 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-09-27 00:02:33,177 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-09-27 00:02:33,178 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-27 00:02:33,178 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-09-27 00:02:33,178 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1695772941817.2774a854ba825d4ae3d366c813a032a8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695772953178"}]},"ts":"9223372036854775807"} 2023-09-27 00:02:33,178 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1695772941817.2e6097ce0f696a23687694deffa1a535.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695772953178"}]},"ts":"9223372036854775807"} 2023-09-27 00:02:33,180 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-27 00:02:33,180 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2774a854ba825d4ae3d366c813a032a8, NAME => 'testtb-testEmptyExportFileSystemState,,1695772941817.2774a854ba825d4ae3d366c813a032a8.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 2e6097ce0f696a23687694deffa1a535, NAME => 'testtb-testEmptyExportFileSystemState,1,1695772941817.2e6097ce0f696a23687694deffa1a535.', STARTKEY => '1', ENDKEY => ''}] 2023-09-27 00:02:33,180 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-09-27 00:02:33,180 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695772953180"}]},"ts":"9223372036854775807"} 2023-09-27 00:02:33,182 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-09-27 00:02:33,183 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-27 00:02:33,185 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 42 msec 2023-09-27 00:02:33,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-27 00:02:33,255 INFO [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-09-27 00:02:33,262 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-09-27 00:02:33,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:33,265 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-09-27 00:02:33,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-09-27 00:02:33,291 INFO [Listener at jenkins-hbase9.apache.org/45033] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=765 (was 760) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1275573626_1 at /127.0.0.1:36862 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x49a14021-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1988502388) connection to jenkins-hbase9.apache.org/172.31.2.10:44775 from appattempt_1695772863328_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1275573626_1 at /127.0.0.1:44568 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x49a14021-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-728144799_17 at /127.0.0.1:57954 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x49a14021-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x49a14021-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4607 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (1988502388) connection to jenkins-hbase9.apache.org/172.31.2.10:43881 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1988502388) connection to jenkins-hbase9.apache.org/172.31.2.10:36057 from appattempt_1695772863328_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-728144799_17 at /127.0.0.1:36880 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-728144799_17 at /127.0.0.1:44604 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=930 (was 911) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=265 (was 237) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=6515 (was 6580) 2023-09-27 00:02:33,291 WARN [Listener at jenkins-hbase9.apache.org/45033] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-09-27 00:02:33,311 INFO [Listener at jenkins-hbase9.apache.org/45033] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765, OpenFileDescriptor=930, MaxFileDescriptor=60000, SystemLoadAverage=265, ProcessCount=168, AvailableMemoryMB=6514 2023-09-27 00:02:33,311 WARN [Listener at jenkins-hbase9.apache.org/45033] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-09-27 00:02:33,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-27 00:02:33,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:33,316 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-09-27 00:02:33,316 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-09-27 00:02:33,316 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-27 00:02:33,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-27 00:02:33,318 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/590cadfcd8d2f03e7e44ecf8f6dc62ec 2023-09-27 00:02:33,318 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c6dba3d8dcd1056ca091f6b46a00de69 2023-09-27 00:02:33,319 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/590cadfcd8d2f03e7e44ecf8f6dc62ec empty. 2023-09-27 00:02:33,319 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c6dba3d8dcd1056ca091f6b46a00de69 empty. 2023-09-27 00:02:33,319 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/590cadfcd8d2f03e7e44ecf8f6dc62ec 2023-09-27 00:02:33,319 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c6dba3d8dcd1056ca091f6b46a00de69 2023-09-27 00:02:33,319 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-27 00:02:33,329 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-09-27 00:02:33,330 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 590cadfcd8d2f03e7e44ecf8f6dc62ec, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695772953312.590cadfcd8d2f03e7e44ecf8f6dc62ec.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp 2023-09-27 00:02:33,330 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => c6dba3d8dcd1056ca091f6b46a00de69, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695772953312.c6dba3d8dcd1056ca091f6b46a00de69.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp 2023-09-27 00:02:33,352 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695772953312.c6dba3d8dcd1056ca091f6b46a00de69.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 00:02:33,352 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing c6dba3d8dcd1056ca091f6b46a00de69, disabling compactions & flushes 2023-09-27 00:02:33,352 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695772953312.c6dba3d8dcd1056ca091f6b46a00de69. 2023-09-27 00:02:33,352 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695772953312.c6dba3d8dcd1056ca091f6b46a00de69. 2023-09-27 00:02:33,352 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695772953312.c6dba3d8dcd1056ca091f6b46a00de69. after waiting 0 ms 2023-09-27 00:02:33,352 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695772953312.c6dba3d8dcd1056ca091f6b46a00de69. 2023-09-27 00:02:33,352 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695772953312.c6dba3d8dcd1056ca091f6b46a00de69. 2023-09-27 00:02:33,352 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for c6dba3d8dcd1056ca091f6b46a00de69: 2023-09-27 00:02:33,352 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695772953312.590cadfcd8d2f03e7e44ecf8f6dc62ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 00:02:33,353 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 590cadfcd8d2f03e7e44ecf8f6dc62ec, disabling compactions & flushes 2023-09-27 00:02:33,353 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695772953312.590cadfcd8d2f03e7e44ecf8f6dc62ec. 2023-09-27 00:02:33,353 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695772953312.590cadfcd8d2f03e7e44ecf8f6dc62ec. 2023-09-27 00:02:33,353 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695772953312.590cadfcd8d2f03e7e44ecf8f6dc62ec. after waiting 0 ms 2023-09-27 00:02:33,353 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695772953312.590cadfcd8d2f03e7e44ecf8f6dc62ec. 2023-09-27 00:02:33,353 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695772953312.590cadfcd8d2f03e7e44ecf8f6dc62ec. 2023-09-27 00:02:33,353 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 590cadfcd8d2f03e7e44ecf8f6dc62ec: 2023-09-27 00:02:33,355 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-09-27 00:02:33,356 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695772953312.c6dba3d8dcd1056ca091f6b46a00de69.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695772953356"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695772953356"}]},"ts":"1695772953356"} 2023-09-27 00:02:33,356 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695772953312.590cadfcd8d2f03e7e44ecf8f6dc62ec.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695772953356"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695772953356"}]},"ts":"1695772953356"} 2023-09-27 00:02:33,359 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-27 00:02:33,359 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-27 00:02:33,360 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695772953359"}]},"ts":"1695772953359"} 2023-09-27 00:02:33,361 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-09-27 00:02:33,364 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-09-27 00:02:33,365 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 00:02:33,366 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 00:02:33,366 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 00:02:33,366 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 00:02:33,366 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=590cadfcd8d2f03e7e44ecf8f6dc62ec, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c6dba3d8dcd1056ca091f6b46a00de69, ASSIGN}] 2023-09-27 00:02:33,368 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c6dba3d8dcd1056ca091f6b46a00de69, ASSIGN 2023-09-27 00:02:33,368 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=590cadfcd8d2f03e7e44ecf8f6dc62ec, ASSIGN 2023-09-27 00:02:33,369 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c6dba3d8dcd1056ca091f6b46a00de69, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,36739,1695772857140; forceNewPlan=false, retain=false 2023-09-27 00:02:33,369 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=590cadfcd8d2f03e7e44ecf8f6dc62ec, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,41703,1695772857103; forceNewPlan=false, retain=false 2023-09-27 00:02:33,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-27 00:02:33,519 INFO [jenkins-hbase9:33541] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-27 00:02:33,522 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=590cadfcd8d2f03e7e44ecf8f6dc62ec, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:33,522 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=c6dba3d8dcd1056ca091f6b46a00de69, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:33,522 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695772953312.590cadfcd8d2f03e7e44ecf8f6dc62ec.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695772953522"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695772953522"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695772953522"}]},"ts":"1695772953522"} 2023-09-27 00:02:33,522 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695772953312.c6dba3d8dcd1056ca091f6b46a00de69.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695772953522"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695772953522"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695772953522"}]},"ts":"1695772953522"} 2023-09-27 00:02:33,524 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 590cadfcd8d2f03e7e44ecf8f6dc62ec, server=jenkins-hbase9.apache.org,41703,1695772857103}] 2023-09-27 00:02:33,525 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure c6dba3d8dcd1056ca091f6b46a00de69, server=jenkins-hbase9.apache.org,36739,1695772857140}] 2023-09-27 00:02:33,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-27 00:02:33,680 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1695772953312.590cadfcd8d2f03e7e44ecf8f6dc62ec. 2023-09-27 00:02:33,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 590cadfcd8d2f03e7e44ecf8f6dc62ec, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695772953312.590cadfcd8d2f03e7e44ecf8f6dc62ec.', STARTKEY => '', ENDKEY => '1'} 2023-09-27 00:02:33,681 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1695772953312.c6dba3d8dcd1056ca091f6b46a00de69. 2023-09-27 00:02:33,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c6dba3d8dcd1056ca091f6b46a00de69, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695772953312.c6dba3d8dcd1056ca091f6b46a00de69.', STARTKEY => '1', ENDKEY => ''} 2023-09-27 00:02:33,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1695772953312.590cadfcd8d2f03e7e44ecf8f6dc62ec. service=AccessControlService 2023-09-27 00:02:33,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1695772953312.c6dba3d8dcd1056ca091f6b46a00de69. service=AccessControlService 2023-09-27 00:02:33,681 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 00:02:33,681 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 00:02:33,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp c6dba3d8dcd1056ca091f6b46a00de69 2023-09-27 00:02:33,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695772953312.c6dba3d8dcd1056ca091f6b46a00de69.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 00:02:33,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 590cadfcd8d2f03e7e44ecf8f6dc62ec 2023-09-27 00:02:33,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for c6dba3d8dcd1056ca091f6b46a00de69 2023-09-27 00:02:33,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695772953312.590cadfcd8d2f03e7e44ecf8f6dc62ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 00:02:33,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for c6dba3d8dcd1056ca091f6b46a00de69 2023-09-27 00:02:33,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 590cadfcd8d2f03e7e44ecf8f6dc62ec 2023-09-27 00:02:33,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 590cadfcd8d2f03e7e44ecf8f6dc62ec 2023-09-27 00:02:33,683 INFO [StoreOpener-c6dba3d8dcd1056ca091f6b46a00de69-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c6dba3d8dcd1056ca091f6b46a00de69 2023-09-27 00:02:33,683 INFO [StoreOpener-590cadfcd8d2f03e7e44ecf8f6dc62ec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 590cadfcd8d2f03e7e44ecf8f6dc62ec 2023-09-27 00:02:33,684 DEBUG [StoreOpener-c6dba3d8dcd1056ca091f6b46a00de69-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithSkipTmp/c6dba3d8dcd1056ca091f6b46a00de69/cf 2023-09-27 00:02:33,684 DEBUG [StoreOpener-c6dba3d8dcd1056ca091f6b46a00de69-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithSkipTmp/c6dba3d8dcd1056ca091f6b46a00de69/cf 2023-09-27 00:02:33,684 DEBUG [StoreOpener-590cadfcd8d2f03e7e44ecf8f6dc62ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithSkipTmp/590cadfcd8d2f03e7e44ecf8f6dc62ec/cf 2023-09-27 00:02:33,684 DEBUG [StoreOpener-590cadfcd8d2f03e7e44ecf8f6dc62ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithSkipTmp/590cadfcd8d2f03e7e44ecf8f6dc62ec/cf 2023-09-27 00:02:33,685 INFO [StoreOpener-c6dba3d8dcd1056ca091f6b46a00de69-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c6dba3d8dcd1056ca091f6b46a00de69 columnFamilyName cf 2023-09-27 00:02:33,685 INFO [StoreOpener-590cadfcd8d2f03e7e44ecf8f6dc62ec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 590cadfcd8d2f03e7e44ecf8f6dc62ec columnFamilyName cf 2023-09-27 00:02:33,686 INFO [StoreOpener-590cadfcd8d2f03e7e44ecf8f6dc62ec-1] regionserver.HStore(310): Store=590cadfcd8d2f03e7e44ecf8f6dc62ec/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 00:02:33,686 INFO [StoreOpener-c6dba3d8dcd1056ca091f6b46a00de69-1] regionserver.HStore(310): Store=c6dba3d8dcd1056ca091f6b46a00de69/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 00:02:33,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithSkipTmp/590cadfcd8d2f03e7e44ecf8f6dc62ec 2023-09-27 00:02:33,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithSkipTmp/c6dba3d8dcd1056ca091f6b46a00de69 2023-09-27 00:02:33,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithSkipTmp/590cadfcd8d2f03e7e44ecf8f6dc62ec 2023-09-27 00:02:33,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithSkipTmp/c6dba3d8dcd1056ca091f6b46a00de69 2023-09-27 00:02:33,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 590cadfcd8d2f03e7e44ecf8f6dc62ec 2023-09-27 00:02:33,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for c6dba3d8dcd1056ca091f6b46a00de69 2023-09-27 00:02:33,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithSkipTmp/590cadfcd8d2f03e7e44ecf8f6dc62ec/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 00:02:33,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithSkipTmp/c6dba3d8dcd1056ca091f6b46a00de69/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 00:02:33,693 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 590cadfcd8d2f03e7e44ecf8f6dc62ec; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73894318, jitterRate=0.10111114382743835}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 00:02:33,694 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened c6dba3d8dcd1056ca091f6b46a00de69; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63687592, jitterRate=-0.05098092555999756}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 00:02:33,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 590cadfcd8d2f03e7e44ecf8f6dc62ec: 2023-09-27 00:02:33,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for c6dba3d8dcd1056ca091f6b46a00de69: 2023-09-27 00:02:33,694 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1695772953312.c6dba3d8dcd1056ca091f6b46a00de69., pid=109, masterSystemTime=1695772953676 2023-09-27 00:02:33,694 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1695772953312.590cadfcd8d2f03e7e44ecf8f6dc62ec., pid=108, masterSystemTime=1695772953675 2023-09-27 00:02:33,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1695772953312.590cadfcd8d2f03e7e44ecf8f6dc62ec. 2023-09-27 00:02:33,696 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1695772953312.590cadfcd8d2f03e7e44ecf8f6dc62ec. 2023-09-27 00:02:33,696 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=590cadfcd8d2f03e7e44ecf8f6dc62ec, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:33,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1695772953312.c6dba3d8dcd1056ca091f6b46a00de69. 2023-09-27 00:02:33,697 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695772953312.590cadfcd8d2f03e7e44ecf8f6dc62ec.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695772953696"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695772953696"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695772953696"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695772953696"}]},"ts":"1695772953696"} 2023-09-27 00:02:33,697 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1695772953312.c6dba3d8dcd1056ca091f6b46a00de69. 2023-09-27 00:02:33,697 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=c6dba3d8dcd1056ca091f6b46a00de69, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:33,697 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695772953312.c6dba3d8dcd1056ca091f6b46a00de69.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695772953697"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695772953697"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695772953697"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695772953697"}]},"ts":"1695772953697"} 2023-09-27 00:02:33,700 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=106 2023-09-27 00:02:33,700 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 590cadfcd8d2f03e7e44ecf8f6dc62ec, server=jenkins-hbase9.apache.org,41703,1695772857103 in 174 msec 2023-09-27 00:02:33,701 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-09-27 00:02:33,701 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure c6dba3d8dcd1056ca091f6b46a00de69, server=jenkins-hbase9.apache.org,36739,1695772857140 in 174 msec 2023-09-27 00:02:33,701 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=590cadfcd8d2f03e7e44ecf8f6dc62ec, ASSIGN in 334 msec 2023-09-27 00:02:33,702 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=107, resume processing ppid=105 2023-09-27 00:02:33,702 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c6dba3d8dcd1056ca091f6b46a00de69, ASSIGN in 335 msec 2023-09-27 00:02:33,703 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-27 00:02:33,703 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695772953703"}]},"ts":"1695772953703"} 2023-09-27 00:02:33,704 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-09-27 00:02:33,711 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-09-27 00:02:33,711 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-09-27 00:02:33,713 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41869] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-27 00:02:33,717 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:02:33,717 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:02:33,717 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:02:33,717 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:02:33,720 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-27 00:02:33,720 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-27 00:02:33,720 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-27 00:02:33,720 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-27 00:02:33,722 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 407 msec 2023-09-27 00:02:33,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-27 00:02:33,920 INFO [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-09-27 00:02:33,922 DEBUG [Listener at jenkins-hbase9.apache.org/45033] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:33,923 DEBUG [Listener at jenkins-hbase9.apache.org/45033] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695772953312.590cadfcd8d2f03e7e44ecf8f6dc62ec. 2023-09-27 00:02:33,925 INFO [Listener at jenkins-hbase9.apache.org/45033] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 00:02:33,936 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-27 00:02:33,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695772953936 (current time:1695772953936). 2023-09-27 00:02:33,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 00:02:33,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(139): Connect 0x2221c49d to 127.0.0.1:57983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 00:02:33,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d39950, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 00:02:33,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 00:02:33,945 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:54322, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 00:02:33,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2221c49d to 127.0.0.1:57983 2023-09-27 00:02:33,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 00:02:33,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(139): Connect 0x07e79772 to 127.0.0.1:57983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 00:02:33,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b4ebe3f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 00:02:33,953 DEBUG [hconnection-0x36caab1f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 00:02:33,955 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:54334, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 00:02:33,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x07e79772 to 127.0.0.1:57983 2023-09-27 00:02:33,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 00:02:33,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-27 00:02:33,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 00:02:33,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-27 00:02:33,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-27 00:02:33,963 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-27 00:02:33,963 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695773553963 2023-09-27 00:02:33,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-27 00:02:33,963 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:33,964 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 00:02:33,964 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 00:02:33,965 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-27 00:02:33,965 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-27 00:02:33,967 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-09-27 00:02:33,968 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-27 00:02:33,972 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695773553972 2023-09-27 00:02:33,981 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:33,981 INFO [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-27 00:02:33,981 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:02:33,983 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-27 00:02:33,983 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-27 00:02:33,983 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:33,983 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:33,985 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:33,985 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:02:33,985 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:02:33,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:02:33,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:02:33,985 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:02:33,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:02:33,985 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:33,985 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:33,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:02:33,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:02:33,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:02:33,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:33,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:33,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:33,986 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:33,986 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 00:02:33,986 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:33,986 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:33,986 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:33,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-27 00:02:33,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-27 00:02:33,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-27 00:02:33,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:33,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:33,987 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-27 00:02:33,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:33,987 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-27 00:02:33,987 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-27 00:02:33,987 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:33,988 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:33,988 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-27 00:02:33,988 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:33,988 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:02:33,988 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-27 00:02:33,988 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-27 00:02:33,989 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:02:33,989 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:02:33,989 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-27 00:02:33,990 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-27 00:02:33,990 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-27 00:02:33,990 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-27 00:02:33,990 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41869,1695772857056' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-27 00:02:33,991 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,36739,1695772857140' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-27 00:02:33,994 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-27 00:02:33,994 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-27 00:02:33,994 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41703,1695772857103' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-27 00:02:34,002 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:34,002 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:34,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:02:34,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:02:34,002 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,003 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:34,003 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:02:34,003 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,003 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,003 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 00:02:34,003 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 00:02:34,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:02:34,003 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,003 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 00:02:34,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:34,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:34,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:34,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:02:34,005 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,36739,1695772857140' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-27 00:02:34,005 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4af33664[Count = 1] remaining members to acquire global barrier 2023-09-27 00:02:34,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:34,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:02:34,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:02:34,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:02:34,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:02:34,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:34,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:34,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:34,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:02:34,006 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,41703,1695772857103' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-27 00:02:34,006 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4af33664[Count = 0] remaining members to acquire global barrier 2023-09-27 00:02:34,006 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-27 00:02:34,006 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,008 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,008 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,008 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,008 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-27 00:02:34,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,008 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-27 00:02:34,008 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:34,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,008 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,41869,1695772857056' in zk 2023-09-27 00:02:34,008 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-27 00:02:34,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,008 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-27 00:02:34,009 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 00:02:34,009 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 00:02:34,009 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695772953312.590cadfcd8d2f03e7e44ecf8f6dc62ec. 2023-09-27 00:02:34,009 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:34,009 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695772953312.c6dba3d8dcd1056ca091f6b46a00de69. 2023-09-27 00:02:34,009 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 00:02:34,009 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695772953312.c6dba3d8dcd1056ca091f6b46a00de69. started... 2023-09-27 00:02:34,009 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 00:02:34,009 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 00:02:34,009 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695772953312.590cadfcd8d2f03e7e44ecf8f6dc62ec. started... 2023-09-27 00:02:34,010 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c6dba3d8dcd1056ca091f6b46a00de69: 2023-09-27 00:02:34,010 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 590cadfcd8d2f03e7e44ecf8f6dc62ec: 2023-09-27 00:02:34,010 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695772953312.c6dba3d8dcd1056ca091f6b46a00de69.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,010 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695772953312.590cadfcd8d2f03e7e44ecf8f6dc62ec.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,010 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 00:02:34,010 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-27 00:02:34,010 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 00:02:34,010 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 00:02:34,010 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:02:34,010 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 00:02:34,010 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-27 00:02:34,020 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695772953312.c6dba3d8dcd1056ca091f6b46a00de69. completed. 2023-09-27 00:02:34,020 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695772953312.c6dba3d8dcd1056ca091f6b46a00de69. 2023-09-27 00:02:34,020 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 00:02:34,020 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 00:02:34,020 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:34,020 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-27 00:02:34,020 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,36739,1695772857140' in zk 2023-09-27 00:02:34,021 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695772953312.590cadfcd8d2f03e7e44ecf8f6dc62ec. completed. 2023-09-27 00:02:34,021 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695772953312.590cadfcd8d2f03e7e44ecf8f6dc62ec. 2023-09-27 00:02:34,021 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 00:02:34,021 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 00:02:34,021 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:34,021 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-27 00:02:34,021 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,41703,1695772857103' in zk 2023-09-27 00:02:34,022 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:34,022 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-27 00:02:34,022 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:02:34,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:34,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:02:34,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:02:34,022 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-27 00:02:34,025 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:34,025 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-27 00:02:34,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:02:34,025 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:02:34,025 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-27 00:02:34,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:02:34,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:34,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:34,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:34,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:02:34,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:34,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:34,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:34,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,36739,1695772857140': 2023-09-27 00:02:34,029 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,36739,1695772857140' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-27 00:02:34,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:34,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:02:34,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:02:34,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:02:34,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:02:34,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:34,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:34,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:34,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:02:34,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:34,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:34,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:34,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,41703,1695772857103': 2023-09-27 00:02:34,033 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,41703,1695772857103' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-27 00:02:34,033 INFO [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-27 00:02:34,033 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 00:02:34,033 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 00:02:34,033 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,033 INFO [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 00:02:34,034 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,034 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,035 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:02:34,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,035 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,034 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,035 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:02:34,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:02:34,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,035 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:02:34,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:02:34,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:02:34,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:02:34,036 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:34,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:02:34,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:02:34,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:02:34,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:02:34,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:02:34,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,036 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:34,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,037 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:34,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:02:34,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:34,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:34,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:34,038 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:34,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:02:34,039 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:34,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,039 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:34,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:34,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:34,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:34,042 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:34,042 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,042 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:02:34,042 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:34,042 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:02:34,042 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:02:34,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:02:34,042 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:02:34,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:02:34,043 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,042 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:34,043 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:02:34,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:02:34,043 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:02:34,043 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:02:34,043 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:02:34,042 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:02:34,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:02:34,043 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:34,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:02:34,043 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:02:34,045 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:02:34,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:02:34,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:02:34,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:02:34,045 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:34,045 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 00:02:34,045 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:34,045 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,045 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,046 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-27 00:02:34,054 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,055 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,064 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 00:02:34,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-27 00:02:34,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-27 00:02:34,066 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 00:02:34,074 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,074 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-27 00:02:34,075 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,075 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,075 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695772953963Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695772954054 (+91 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695772954054Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695772954054Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695772954058 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695772954069 (+11 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695772954074 (+5 ms) 2023-09-27 00:02:34,078 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-27 00:02:34,079 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 114 msec 2023-09-27 00:02:34,266 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 00:02:34,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-27 00:02:34,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 00:02:34,269 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41703] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1695772953312.590cadfcd8d2f03e7e44ecf8f6dc62ec. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 00:02:34,270 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36739] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1695772953312.c6dba3d8dcd1056ca091f6b46a00de69. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 00:02:34,272 DEBUG [Listener at jenkins-hbase9.apache.org/45033] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,272 DEBUG [Listener at jenkins-hbase9.apache.org/45033] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695772953312.590cadfcd8d2f03e7e44ecf8f6dc62ec. 2023-09-27 00:02:34,273 INFO [Listener at jenkins-hbase9.apache.org/45033] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 00:02:34,281 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-27 00:02:34,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695772954281 (current time:1695772954281). 2023-09-27 00:02:34,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 00:02:34,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(139): Connect 0x4ad200ab to 127.0.0.1:57983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 00:02:34,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2923c8bd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 00:02:34,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 00:02:34,292 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:54348, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 00:02:34,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ad200ab to 127.0.0.1:57983 2023-09-27 00:02:34,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 00:02:34,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(139): Connect 0x2831ec5a to 127.0.0.1:57983 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 00:02:34,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@723c66af, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 00:02:34,300 DEBUG [hconnection-0x456d3e75-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 00:02:34,301 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:54356, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 00:02:34,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2831ec5a to 127.0.0.1:57983 2023-09-27 00:02:34,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 00:02:34,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-27 00:02:34,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 00:02:34,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-27 00:02:34,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-27 00:02:34,310 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-27 00:02:34,311 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695773554311 2023-09-27 00:02:34,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-27 00:02:34,311 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,312 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 00:02:34,312 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 00:02:34,313 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-27 00:02:34,314 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-27 00:02:34,315 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-09-27 00:02:34,316 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-27 00:02:34,316 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695773554316 2023-09-27 00:02:34,328 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,328 INFO [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-27 00:02:34,328 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:02:34,330 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-27 00:02:34,330 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-27 00:02:34,330 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,330 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,332 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:02:34,332 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:02:34,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:02:34,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:02:34,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:02:34,332 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:02:34,332 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:34,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:02:34,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:02:34,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:02:34,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,333 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:34,333 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:34,333 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,333 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,333 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:34,333 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 00:02:34,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-27 00:02:34,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,333 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,333 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-27 00:02:34,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-27 00:02:34,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,333 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-27 00:02:34,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-27 00:02:34,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,333 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,334 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-27 00:02:34,334 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-27 00:02:34,334 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:02:34,334 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,335 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,335 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-27 00:02:34,335 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-27 00:02:34,335 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-27 00:02:34,336 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-27 00:02:34,336 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41703,1695772857103' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-27 00:02:34,335 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:02:34,335 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 00:02:34,337 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-27 00:02:34,337 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-27 00:02:34,337 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-27 00:02:34,338 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-27 00:02:34,338 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,36739,1695772857140' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-27 00:02:34,337 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41869,1695772857056' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-27 00:02:34,339 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:34,339 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:34,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:02:34,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:02:34,340 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,340 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,340 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:34,340 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:02:34,340 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 00:02:34,340 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,340 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 00:02:34,340 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,340 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 00:02:34,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:02:34,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:34,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:34,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:34,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:02:34,342 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,41703,1695772857103' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-27 00:02:34,342 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ffdb4e3[Count = 1] remaining members to acquire global barrier 2023-09-27 00:02:34,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:34,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:02:34,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:02:34,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:02:34,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:02:34,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:34,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:34,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:34,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:02:34,344 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,36739,1695772857140' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-27 00:02:34,344 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ffdb4e3[Count = 0] remaining members to acquire global barrier 2023-09-27 00:02:34,344 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-27 00:02:34,344 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,349 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,349 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,349 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,349 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-27 00:02:34,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,350 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-27 00:02:34,350 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-27 00:02:34,350 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-27 00:02:34,350 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:34,350 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,41869,1695772857056' in zk 2023-09-27 00:02:34,350 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 00:02:34,350 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 00:02:34,350 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 00:02:34,350 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 00:02:34,350 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695772953312.590cadfcd8d2f03e7e44ecf8f6dc62ec. 2023-09-27 00:02:34,350 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695772953312.c6dba3d8dcd1056ca091f6b46a00de69. 2023-09-27 00:02:34,350 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:34,350 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 00:02:34,350 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695772953312.590cadfcd8d2f03e7e44ecf8f6dc62ec. started... 2023-09-27 00:02:34,350 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695772953312.c6dba3d8dcd1056ca091f6b46a00de69. started... 2023-09-27 00:02:34,350 INFO [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 590cadfcd8d2f03e7e44ecf8f6dc62ec 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-27 00:02:34,350 INFO [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c6dba3d8dcd1056ca091f6b46a00de69 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-27 00:02:34,351 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-27 00:02:34,351 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:02:34,351 DEBUG [member: 'jenkins-hbase9.apache.org,41869,1695772857056' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-27 00:02:34,376 INFO [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309270f31e60c09054e39aad331dc7a094d29 to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309270f31e60c09054e39aad331dc7a094d29 2023-09-27 00:02:34,379 INFO [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309278032544bc54946e0a0a84c3e97d1dcea to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309278032544bc54946e0a0a84c3e97d1dcea 2023-09-27 00:02:34,386 INFO [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithSkipTmp/590cadfcd8d2f03e7e44ecf8f6dc62ec/.tmp/cf/2c0725929bce4ebdab82027562c5448a 2023-09-27 00:02:34,390 INFO [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithSkipTmp/c6dba3d8dcd1056ca091f6b46a00de69/.tmp/cf/3eddd80bfbab45b485581be644ab867f 2023-09-27 00:02:34,391 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithSkipTmp/590cadfcd8d2f03e7e44ecf8f6dc62ec/.tmp/cf/2c0725929bce4ebdab82027562c5448a as hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithSkipTmp/590cadfcd8d2f03e7e44ecf8f6dc62ec/cf/2c0725929bce4ebdab82027562c5448a 2023-09-27 00:02:34,395 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithSkipTmp/c6dba3d8dcd1056ca091f6b46a00de69/.tmp/cf/3eddd80bfbab45b485581be644ab867f as hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithSkipTmp/c6dba3d8dcd1056ca091f6b46a00de69/cf/3eddd80bfbab45b485581be644ab867f 2023-09-27 00:02:34,396 INFO [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithSkipTmp/590cadfcd8d2f03e7e44ecf8f6dc62ec/cf/2c0725929bce4ebdab82027562c5448a, entries=3, sequenceid=6, filesize=5.4 K 2023-09-27 00:02:34,398 INFO [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 590cadfcd8d2f03e7e44ecf8f6dc62ec in 48ms, sequenceid=6, compaction requested=false 2023-09-27 00:02:34,398 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-27 00:02:34,399 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 590cadfcd8d2f03e7e44ecf8f6dc62ec: 2023-09-27 00:02:34,399 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695772953312.590cadfcd8d2f03e7e44ecf8f6dc62ec.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,399 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 00:02:34,399 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithSkipTmp/590cadfcd8d2f03e7e44ecf8f6dc62ec/cf/2c0725929bce4ebdab82027562c5448a] hfiles 2023-09-27 00:02:34,399 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithSkipTmp/590cadfcd8d2f03e7e44ecf8f6dc62ec/cf/2c0725929bce4ebdab82027562c5448a for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,402 INFO [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithSkipTmp/c6dba3d8dcd1056ca091f6b46a00de69/cf/3eddd80bfbab45b485581be644ab867f, entries=47, sequenceid=6, filesize=13.3 K 2023-09-27 00:02:34,403 INFO [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for c6dba3d8dcd1056ca091f6b46a00de69 in 53ms, sequenceid=6, compaction requested=false 2023-09-27 00:02:34,404 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c6dba3d8dcd1056ca091f6b46a00de69: 2023-09-27 00:02:34,404 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695772953312.c6dba3d8dcd1056ca091f6b46a00de69.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,405 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 00:02:34,405 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithSkipTmp/c6dba3d8dcd1056ca091f6b46a00de69/cf/3eddd80bfbab45b485581be644ab867f] hfiles 2023-09-27 00:02:34,405 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithSkipTmp/c6dba3d8dcd1056ca091f6b46a00de69/cf/3eddd80bfbab45b485581be644ab867f for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,407 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695772953312.590cadfcd8d2f03e7e44ecf8f6dc62ec. completed. 2023-09-27 00:02:34,407 DEBUG [rs(jenkins-hbase9.apache.org,41703,1695772857103)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695772953312.590cadfcd8d2f03e7e44ecf8f6dc62ec. 2023-09-27 00:02:34,407 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 00:02:34,407 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 00:02:34,407 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:34,407 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-27 00:02:34,408 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,41703,1695772857103' in zk 2023-09-27 00:02:34,409 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-27 00:02:34,409 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:34,409 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:02:34,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:34,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:02:34,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:02:34,409 DEBUG [member: 'jenkins-hbase9.apache.org,41703,1695772857103' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-27 00:02:34,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:02:34,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:02:34,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:34,412 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695772953312.c6dba3d8dcd1056ca091f6b46a00de69. completed. 2023-09-27 00:02:34,412 DEBUG [rs(jenkins-hbase9.apache.org,36739,1695772857140)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695772953312.c6dba3d8dcd1056ca091f6b46a00de69. 2023-09-27 00:02:34,412 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 00:02:34,412 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 00:02:34,412 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:34,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:34,412 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-27 00:02:34,413 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 00:02:34,413 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,36739,1695772857140' in zk 2023-09-27 00:02:34,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:34,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-27 00:02:34,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-27 00:02:34,414 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 00:02:34,415 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:34,415 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-27 00:02:34,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:02:34,415 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:02:34,415 DEBUG [member: 'jenkins-hbase9.apache.org,36739,1695772857140' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-27 00:02:34,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:34,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:34,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:34,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,41703,1695772857103': 2023-09-27 00:02:34,418 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,41703,1695772857103' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-27 00:02:34,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:34,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:02:34,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:02:34,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:02:34,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:02:34,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:34,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:34,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:34,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:02:34,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:34,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:34,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:34,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,36739,1695772857140': 2023-09-27 00:02:34,421 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,36739,1695772857140' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-27 00:02:34,421 INFO [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-27 00:02:34,421 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 00:02:34,421 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 00:02:34,421 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,421 INFO [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 00:02:34,422 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,422 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,423 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,423 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:02:34,423 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:02:34,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 00:02:34,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 00:02:34,422 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,423 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:02:34,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,423 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:34,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:02:34,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 00:02:34,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:02:34,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:02:34,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:02:34,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:02:34,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:02:34,424 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:34,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 00:02:34,424 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:34,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:34,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:34,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:34,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 00:02:34,426 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:34,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,426 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:34,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:34,426 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:34,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:34,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:34,428 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:34,428 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,428 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:02:34,428 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:34,428 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:02:34,429 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:34,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:02:34,429 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:02:34,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:02:34,429 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:02:34,429 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 00:02:34,429 DEBUG [(jenkins-hbase9.apache.org,33541,1695772855814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 00:02:34,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 00:02:34,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:02:34,429 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,429 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 00:02:34,430 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:02:34,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 00:02:34,429 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:02:34,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:02:34,430 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,431 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:34,431 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 00:02:34,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:02:34,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:02:34,431 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 00:02:34,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 00:02:34,431 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:02:34,431 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:34,431 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,431 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,431 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309278032544bc54946e0a0a84c3e97d1dcea, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309270f31e60c09054e39aad331dc7a094d29] mob files 2023-09-27 00:02:34,432 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309278032544bc54946e0a0a84c3e97d1dcea 2023-09-27 00:02:34,432 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309270f31e60c09054e39aad331dc7a094d29 2023-09-27 00:02:34,438 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,438 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,453 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,454 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-27 00:02:34,454 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,454 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,454 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695772954311Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695772954438 (+127 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695772954438Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1695772954438Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1695772954441 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695772954447 (+6 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695772954454 (+7 ms) 2023-09-27 00:02:34,457 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-27 00:02:34,458 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 145 msec 2023-09-27 00:02:34,614 DEBUG [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 00:02:34,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-27 00:02:34,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 00:02:34,615 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772954615 2023-09-27 00:02:34,615 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40313, tgtDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772954615, rawTgtDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772954615, srcFsUri=hdfs://localhost:40313, srcDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8 2023-09-27 00:02:34,637 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40313, inputRoot=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8 2023-09-27 00:02:34,637 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-165323230_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772954615, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772954615/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,637 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40313, inputRoot=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8, snapshotDir=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-09-27 00:02:34,652 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772954615/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:34,669 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-27 00:02:34,669 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-27 00:02:34,669 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-27 00:02:34,670 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-27 00:02:35,537 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/hadoop-7960152113660025207.jar 2023-09-27 00:02:35,538 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-27 00:02:35,538 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-27 00:02:35,603 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/hadoop-5588300835826640294.jar 2023-09-27 00:02:35,603 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-27 00:02:35,604 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-27 00:02:35,604 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-27 00:02:35,605 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-27 00:02:35,605 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-27 00:02:35,605 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-27 00:02:35,605 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-27 00:02:35,606 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-27 00:02:35,606 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-27 00:02:35,606 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-27 00:02:35,607 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-27 00:02:35,607 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-27 00:02:35,608 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-27 00:02:35,608 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-27 00:02:35,608 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-27 00:02:35,609 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-27 00:02:35,609 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 00:02:35,610 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 00:02:35,610 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 00:02:35,610 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 00:02:35,610 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 00:02:35,611 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 00:02:35,611 DEBUG [Listener at jenkins-hbase9.apache.org/45033] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 00:02:35,944 WARN [Listener at jenkins-hbase9.apache.org/45033] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-27 00:02:35,946 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-09-27 00:02:35,947 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-09-27 00:02:37,230 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 00:02:37,230 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 00:02:37,233 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695772863328_0006_000001 (auth:SIMPLE) 2023-09-27 00:02:37,426 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695772863328_0007_000001 (auth:SIMPLE) 2023-09-27 00:02:38,602 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-27 00:02:41,230 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695772863328_0007_000001 (auth:SIMPLE) 2023-09-27 00:02:43,446 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695772863328_0007_000001 (auth:SIMPLE) 2023-09-27 00:02:46,020 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695772863328_0007_000001 (auth:SIMPLE) 2023-09-27 00:02:47,101 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-27 00:02:47,101 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-27 00:02:47,112 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:47,112 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-27 00:02:47,113 INFO [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-27 00:02:47,113 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-728144799_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:47,113 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(367): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-27 00:02:47,113 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(367): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-27 00:02:47,113 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-728144799_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772954615/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772954615/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:47,114 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(367): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772954615/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-27 00:02:47,114 DEBUG [Listener at jenkins-hbase9.apache.org/45033] snapshot.TestExportSnapshot(367): hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/export-test/export-1695772954615/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-27 00:02:47,119 INFO [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:47,119 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:47,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:47,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-27 00:02:47,124 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695772967123"}]},"ts":"1695772967123"} 2023-09-27 00:02:47,125 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-09-27 00:02:47,126 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-09-27 00:02:47,127 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=590cadfcd8d2f03e7e44ecf8f6dc62ec, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c6dba3d8dcd1056ca091f6b46a00de69, UNASSIGN}] 2023-09-27 00:02:47,129 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=590cadfcd8d2f03e7e44ecf8f6dc62ec, UNASSIGN 2023-09-27 00:02:47,129 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c6dba3d8dcd1056ca091f6b46a00de69, UNASSIGN 2023-09-27 00:02:47,130 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=590cadfcd8d2f03e7e44ecf8f6dc62ec, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:02:47,130 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=c6dba3d8dcd1056ca091f6b46a00de69, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:02:47,130 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695772953312.c6dba3d8dcd1056ca091f6b46a00de69.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695772967130"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695772967130"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695772967130"}]},"ts":"1695772967130"} 2023-09-27 00:02:47,130 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695772953312.590cadfcd8d2f03e7e44ecf8f6dc62ec.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695772967130"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695772967130"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695772967130"}]},"ts":"1695772967130"} 2023-09-27 00:02:47,131 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 590cadfcd8d2f03e7e44ecf8f6dc62ec, server=jenkins-hbase9.apache.org,41703,1695772857103}] 2023-09-27 00:02:47,132 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure c6dba3d8dcd1056ca091f6b46a00de69, server=jenkins-hbase9.apache.org,36739,1695772857140}] 2023-09-27 00:02:47,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-27 00:02:47,283 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 590cadfcd8d2f03e7e44ecf8f6dc62ec 2023-09-27 00:02:47,283 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close c6dba3d8dcd1056ca091f6b46a00de69 2023-09-27 00:02:47,283 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 590cadfcd8d2f03e7e44ecf8f6dc62ec, disabling compactions & flushes 2023-09-27 00:02:47,284 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing c6dba3d8dcd1056ca091f6b46a00de69, disabling compactions & flushes 2023-09-27 00:02:47,284 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695772953312.590cadfcd8d2f03e7e44ecf8f6dc62ec. 2023-09-27 00:02:47,284 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695772953312.c6dba3d8dcd1056ca091f6b46a00de69. 2023-09-27 00:02:47,284 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695772953312.c6dba3d8dcd1056ca091f6b46a00de69. 2023-09-27 00:02:47,284 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695772953312.590cadfcd8d2f03e7e44ecf8f6dc62ec. 2023-09-27 00:02:47,284 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695772953312.c6dba3d8dcd1056ca091f6b46a00de69. after waiting 0 ms 2023-09-27 00:02:47,284 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695772953312.c6dba3d8dcd1056ca091f6b46a00de69. 2023-09-27 00:02:47,284 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695772953312.590cadfcd8d2f03e7e44ecf8f6dc62ec. after waiting 0 ms 2023-09-27 00:02:47,284 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695772953312.590cadfcd8d2f03e7e44ecf8f6dc62ec. 2023-09-27 00:02:47,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithSkipTmp/590cadfcd8d2f03e7e44ecf8f6dc62ec/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 00:02:47,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/default/testtb-testExportFileSystemStateWithSkipTmp/c6dba3d8dcd1056ca091f6b46a00de69/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 00:02:47,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 00:02:47,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 00:02:47,296 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695772953312.590cadfcd8d2f03e7e44ecf8f6dc62ec. 2023-09-27 00:02:47,297 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 590cadfcd8d2f03e7e44ecf8f6dc62ec: 2023-09-27 00:02:47,297 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695772953312.c6dba3d8dcd1056ca091f6b46a00de69. 2023-09-27 00:02:47,297 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for c6dba3d8dcd1056ca091f6b46a00de69: 2023-09-27 00:02:47,299 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 590cadfcd8d2f03e7e44ecf8f6dc62ec 2023-09-27 00:02:47,299 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=590cadfcd8d2f03e7e44ecf8f6dc62ec, regionState=CLOSED 2023-09-27 00:02:47,299 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695772953312.590cadfcd8d2f03e7e44ecf8f6dc62ec.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695772967299"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695772967299"}]},"ts":"1695772967299"} 2023-09-27 00:02:47,299 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed c6dba3d8dcd1056ca091f6b46a00de69 2023-09-27 00:02:47,300 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=c6dba3d8dcd1056ca091f6b46a00de69, regionState=CLOSED 2023-09-27 00:02:47,300 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695772953312.c6dba3d8dcd1056ca091f6b46a00de69.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695772967300"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695772967300"}]},"ts":"1695772967300"} 2023-09-27 00:02:47,302 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-09-27 00:02:47,302 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 590cadfcd8d2f03e7e44ecf8f6dc62ec, server=jenkins-hbase9.apache.org,41703,1695772857103 in 170 msec 2023-09-27 00:02:47,303 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-09-27 00:02:47,304 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure c6dba3d8dcd1056ca091f6b46a00de69, server=jenkins-hbase9.apache.org,36739,1695772857140 in 169 msec 2023-09-27 00:02:47,304 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=590cadfcd8d2f03e7e44ecf8f6dc62ec, UNASSIGN in 175 msec 2023-09-27 00:02:47,305 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=116, resume processing ppid=114 2023-09-27 00:02:47,305 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c6dba3d8dcd1056ca091f6b46a00de69, UNASSIGN in 177 msec 2023-09-27 00:02:47,306 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695772967306"}]},"ts":"1695772967306"} 2023-09-27 00:02:47,307 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-09-27 00:02:47,309 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-09-27 00:02:47,310 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 189 msec 2023-09-27 00:02:47,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-27 00:02:47,426 INFO [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-09-27 00:02:47,427 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:47,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:47,430 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:47,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:47,430 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:47,432 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41869] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:47,434 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/590cadfcd8d2f03e7e44ecf8f6dc62ec 2023-09-27 00:02:47,434 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c6dba3d8dcd1056ca091f6b46a00de69 2023-09-27 00:02:47,435 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:47,435 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:47,435 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:47,436 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-27 00:02:47,436 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-27 00:02:47,436 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:47,436 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-27 00:02:47,437 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/590cadfcd8d2f03e7e44ecf8f6dc62ec/cf, FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/590cadfcd8d2f03e7e44ecf8f6dc62ec/recovered.edits] 2023-09-27 00:02:47,437 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c6dba3d8dcd1056ca091f6b46a00de69/cf, FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c6dba3d8dcd1056ca091f6b46a00de69/recovered.edits] 2023-09-27 00:02:47,438 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:47,438 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:02:47,438 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:47,438 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:47,438 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:02:47,438 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:02:47,438 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-09-27 00:02:47,438 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 00:02:47,438 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-27 00:02:47,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-27 00:02:47,466 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/590cadfcd8d2f03e7e44ecf8f6dc62ec/cf/2c0725929bce4ebdab82027562c5448a to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/590cadfcd8d2f03e7e44ecf8f6dc62ec/cf/2c0725929bce4ebdab82027562c5448a 2023-09-27 00:02:47,466 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c6dba3d8dcd1056ca091f6b46a00de69/cf/3eddd80bfbab45b485581be644ab867f to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/c6dba3d8dcd1056ca091f6b46a00de69/cf/3eddd80bfbab45b485581be644ab867f 2023-09-27 00:02:47,470 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/590cadfcd8d2f03e7e44ecf8f6dc62ec/recovered.edits/9.seqid to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/590cadfcd8d2f03e7e44ecf8f6dc62ec/recovered.edits/9.seqid 2023-09-27 00:02:47,470 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c6dba3d8dcd1056ca091f6b46a00de69/recovered.edits/9.seqid to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/c6dba3d8dcd1056ca091f6b46a00de69/recovered.edits/9.seqid 2023-09-27 00:02:47,470 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c6dba3d8dcd1056ca091f6b46a00de69 2023-09-27 00:02:47,470 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/590cadfcd8d2f03e7e44ecf8f6dc62ec 2023-09-27 00:02:47,470 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-27 00:02:47,471 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-27 00:02:47,471 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-09-27 00:02:47,474 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309278032544bc54946e0a0a84c3e97d1dcea to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309278032544bc54946e0a0a84c3e97d1dcea 2023-09-27 00:02:47,475 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309270f31e60c09054e39aad331dc7a094d29 to hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309270f31e60c09054e39aad331dc7a094d29 2023-09-27 00:02:47,476 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-27 00:02:47,478 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:47,480 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-09-27 00:02:47,482 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-09-27 00:02:47,483 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:47,483 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-09-27 00:02:47,483 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695772953312.590cadfcd8d2f03e7e44ecf8f6dc62ec.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695772967483"}]},"ts":"9223372036854775807"} 2023-09-27 00:02:47,483 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695772953312.c6dba3d8dcd1056ca091f6b46a00de69.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695772967483"}]},"ts":"9223372036854775807"} 2023-09-27 00:02:47,485 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-27 00:02:47,485 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 590cadfcd8d2f03e7e44ecf8f6dc62ec, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695772953312.590cadfcd8d2f03e7e44ecf8f6dc62ec.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c6dba3d8dcd1056ca091f6b46a00de69, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695772953312.c6dba3d8dcd1056ca091f6b46a00de69.', STARTKEY => '1', ENDKEY => ''}] 2023-09-27 00:02:47,485 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-09-27 00:02:47,485 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695772967485"}]},"ts":"9223372036854775807"} 2023-09-27 00:02:47,487 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-09-27 00:02:47,489 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:47,490 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 62 msec 2023-09-27 00:02:47,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-27 00:02:47,565 INFO [Listener at jenkins-hbase9.apache.org/45033] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-09-27 00:02:47,572 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-27 00:02:47,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:47,575 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-27 00:02:47,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33541] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 00:02:47,601 INFO [Listener at jenkins-hbase9.apache.org/45033] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764 (was 765), OpenFileDescriptor=911 (was 930), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=240 (was 265), ProcessCount=168 (was 168), AvailableMemoryMB=6428 (was 6514) 2023-09-27 00:02:47,601 WARN [Listener at jenkins-hbase9.apache.org/45033] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-09-27 00:02:47,601 INFO [Listener at jenkins-hbase9.apache.org/45033] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-09-27 00:02:47,612 INFO [Listener at jenkins-hbase9.apache.org/45033] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-09-27 00:02:52,194 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695772863328_0007_000001 (auth:SIMPLE) 2023-09-27 00:02:52,862 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-27 00:03:01,737 INFO [Listener at jenkins-hbase9.apache.org/45033] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-09-27 00:03:15,853 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-27 00:03:15,854 INFO [Listener at jenkins-hbase9.apache.org/45033] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-09-27 00:03:15,963 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-09-27 00:03:15,971 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-09-27 00:03:15,972 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-27 00:03:15,978 INFO [Listener at jenkins-hbase9.apache.org/45033] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-09-27 00:03:16,082 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-27 00:03:16,082 INFO [Listener at jenkins-hbase9.apache.org/45033] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-09-27 00:03:16,082 INFO [Listener at jenkins-hbase9.apache.org/45033] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-09-27 00:03:16,083 INFO [Listener at jenkins-hbase9.apache.org/45033] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-09-27 00:03:16,083 DEBUG [Listener at jenkins-hbase9.apache.org/45033] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x52492d35 to 127.0.0.1:57983 2023-09-27 00:03:16,083 DEBUG [Listener at jenkins-hbase9.apache.org/45033] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 00:03:16,083 DEBUG [Listener at jenkins-hbase9.apache.org/45033] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-09-27 00:03:16,083 DEBUG [Listener at jenkins-hbase9.apache.org/45033] util.JVMClusterUtil(257): Found active master hash=1844215420, stopped=false 2023-09-27 00:03:16,084 DEBUG [Listener at jenkins-hbase9.apache.org/45033] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 00:03:16,084 DEBUG [Listener at jenkins-hbase9.apache.org/45033] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-27 00:03:16,084 INFO [Listener at jenkins-hbase9.apache.org/45033] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase9.apache.org,33541,1695772855814 2023-09-27 00:03:16,085 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-27 00:03:16,085 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-27 00:03:16,085 INFO [Listener at jenkins-hbase9.apache.org/45033] procedure2.ProcedureExecutor(628): Stopping 2023-09-27 00:03:16,085 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 00:03:16,085 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-27 00:03:16,085 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-27 00:03:16,086 DEBUG [Listener at jenkins-hbase9.apache.org/45033] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2cf31254 to 127.0.0.1:57983 2023-09-27 00:03:16,086 DEBUG [Listener at jenkins-hbase9.apache.org/45033] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 00:03:16,086 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-27 00:03:16,086 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-27 00:03:16,086 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-27 00:03:16,086 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-27 00:03:16,086 INFO [Listener at jenkins-hbase9.apache.org/45033] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,41869,1695772857056' ***** 2023-09-27 00:03:16,086 DEBUG [Listener at jenkins-hbase9.apache.org/45033] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 00:03:16,087 INFO [Listener at jenkins-hbase9.apache.org/45033] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-27 00:03:16,087 INFO [Listener at jenkins-hbase9.apache.org/45033] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,41703,1695772857103' ***** 2023-09-27 00:03:16,087 DEBUG [Listener at jenkins-hbase9.apache.org/45033] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 00:03:16,087 INFO [RS:0;jenkins-hbase9:41869] regionserver.HeapMemoryManager(220): Stopping 2023-09-27 00:03:16,087 INFO [Listener at jenkins-hbase9.apache.org/45033] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-27 00:03:16,087 INFO [Listener at jenkins-hbase9.apache.org/45033] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,36739,1695772857140' ***** 2023-09-27 00:03:16,087 DEBUG [Listener at jenkins-hbase9.apache.org/45033] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 00:03:16,087 INFO [RS:1;jenkins-hbase9:41703] regionserver.HeapMemoryManager(220): Stopping 2023-09-27 00:03:16,087 INFO [RS:0;jenkins-hbase9:41869] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-27 00:03:16,087 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-27 00:03:16,087 INFO [RS:0;jenkins-hbase9:41869] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-27 00:03:16,087 INFO [RS:1;jenkins-hbase9:41703] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-27 00:03:16,087 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-27 00:03:16,087 INFO [Listener at jenkins-hbase9.apache.org/45033] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-27 00:03:16,087 INFO [RS:0;jenkins-hbase9:41869] regionserver.HRegionServer(3305): Received CLOSE for cbc027ae1d474285c288d6078456fdb6 2023-09-27 00:03:16,087 INFO [RS:1;jenkins-hbase9:41703] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-27 00:03:16,087 INFO [RS:2;jenkins-hbase9:36739] regionserver.HeapMemoryManager(220): Stopping 2023-09-27 00:03:16,088 INFO [RS:2;jenkins-hbase9:36739] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-27 00:03:16,088 INFO [RS:1;jenkins-hbase9:41703] regionserver.HRegionServer(3305): Received CLOSE for 4e820a82ca89c8ef3cf272c45cf6afe2 2023-09-27 00:03:16,088 INFO [RS:0;jenkins-hbase9:41869] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:03:16,088 INFO [RS:1;jenkins-hbase9:41703] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:03:16,088 DEBUG [RS:0;jenkins-hbase9:41869] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0bd8602b to 127.0.0.1:57983 2023-09-27 00:03:16,088 DEBUG [RS:1;jenkins-hbase9:41703] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x46c2a243 to 127.0.0.1:57983 2023-09-27 00:03:16,088 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-27 00:03:16,088 DEBUG [RS:1;jenkins-hbase9:41703] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 00:03:16,088 INFO [RS:2;jenkins-hbase9:36739] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-27 00:03:16,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 4e820a82ca89c8ef3cf272c45cf6afe2, disabling compactions & flushes 2023-09-27 00:03:16,089 INFO [RS:2;jenkins-hbase9:36739] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:03:16,089 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695772859129.4e820a82ca89c8ef3cf272c45cf6afe2. 2023-09-27 00:03:16,089 INFO [RS:1;jenkins-hbase9:41703] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-27 00:03:16,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing cbc027ae1d474285c288d6078456fdb6, disabling compactions & flushes 2023-09-27 00:03:16,088 DEBUG [RS:0;jenkins-hbase9:41869] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 00:03:16,090 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695772859864.cbc027ae1d474285c288d6078456fdb6. 2023-09-27 00:03:16,090 DEBUG [RS:1;jenkins-hbase9:41703] regionserver.HRegionServer(1478): Online Regions={4e820a82ca89c8ef3cf272c45cf6afe2=hbase:namespace,,1695772859129.4e820a82ca89c8ef3cf272c45cf6afe2.} 2023-09-27 00:03:16,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695772859129.4e820a82ca89c8ef3cf272c45cf6afe2. 2023-09-27 00:03:16,089 DEBUG [RS:2;jenkins-hbase9:36739] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4c945755 to 127.0.0.1:57983 2023-09-27 00:03:16,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695772859129.4e820a82ca89c8ef3cf272c45cf6afe2. after waiting 0 ms 2023-09-27 00:03:16,092 INFO [RS:0;jenkins-hbase9:41869] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-27 00:03:16,092 INFO [RS:0;jenkins-hbase9:41869] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-27 00:03:16,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695772859864.cbc027ae1d474285c288d6078456fdb6. 2023-09-27 00:03:16,092 INFO [RS:0;jenkins-hbase9:41869] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-27 00:03:16,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695772859864.cbc027ae1d474285c288d6078456fdb6. after waiting 0 ms 2023-09-27 00:03:16,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695772859864.cbc027ae1d474285c288d6078456fdb6. 2023-09-27 00:03:16,092 INFO [RS:0;jenkins-hbase9:41869] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-09-27 00:03:16,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695772859129.4e820a82ca89c8ef3cf272c45cf6afe2. 2023-09-27 00:03:16,092 DEBUG [RS:2;jenkins-hbase9:36739] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 00:03:16,092 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 4e820a82ca89c8ef3cf272c45cf6afe2 1/1 column families, dataSize=78 B heapSize=488 B 2023-09-27 00:03:16,092 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing cbc027ae1d474285c288d6078456fdb6 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-09-27 00:03:16,093 INFO [RS:0;jenkins-hbase9:41869] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-09-27 00:03:16,093 INFO [RS:2;jenkins-hbase9:36739] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,36739,1695772857140; all regions closed. 2023-09-27 00:03:16,093 DEBUG [RS:0;jenkins-hbase9:41869] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, cbc027ae1d474285c288d6078456fdb6=hbase:acl,,1695772859864.cbc027ae1d474285c288d6078456fdb6.} 2023-09-27 00:03:16,093 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-27 00:03:16,093 DEBUG [RS:1;jenkins-hbase9:41703] regionserver.HRegionServer(1504): Waiting on 4e820a82ca89c8ef3cf272c45cf6afe2 2023-09-27 00:03:16,093 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-27 00:03:16,093 DEBUG [RS:0;jenkins-hbase9:41869] regionserver.HRegionServer(1504): Waiting on 1588230740, cbc027ae1d474285c288d6078456fdb6 2023-09-27 00:03:16,094 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-27 00:03:16,094 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-27 00:03:16,094 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-27 00:03:16,094 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-09-27 00:03:16,116 DEBUG [RS:2;jenkins-hbase9:36739] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/oldWALs 2023-09-27 00:03:16,116 INFO [RS:2;jenkins-hbase9:36739] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C36739%2C1695772857140:(num 1695772858672) 2023-09-27 00:03:16,116 DEBUG [RS:2;jenkins-hbase9:36739] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 00:03:16,116 INFO [RS:2;jenkins-hbase9:36739] regionserver.LeaseManager(133): Closed leases 2023-09-27 00:03:16,119 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/hbase/acl/cbc027ae1d474285c288d6078456fdb6/.tmp/l/9e276c86170646049f4fdc351e8cfeca 2023-09-27 00:03:16,119 INFO [RS:2;jenkins-hbase9:36739] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-27 00:03:16,119 INFO [RS:2;jenkins-hbase9:36739] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-27 00:03:16,119 INFO [RS:2;jenkins-hbase9:36739] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-27 00:03:16,119 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-27 00:03:16,119 INFO [RS:2;jenkins-hbase9:36739] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-27 00:03:16,121 INFO [RS:2;jenkins-hbase9:36739] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:36739 2023-09-27 00:03:16,125 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/hbase/meta/1588230740/.tmp/info/b457707825e54617b00d3c42370e59d5 2023-09-27 00:03:16,127 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9e276c86170646049f4fdc351e8cfeca 2023-09-27 00:03:16,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/hbase/acl/cbc027ae1d474285c288d6078456fdb6/.tmp/l/9e276c86170646049f4fdc351e8cfeca as hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/hbase/acl/cbc027ae1d474285c288d6078456fdb6/l/9e276c86170646049f4fdc351e8cfeca 2023-09-27 00:03:16,128 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:03:16,128 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-27 00:03:16,128 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:03:16,128 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-27 00:03:16,128 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,36739,1695772857140 2023-09-27 00:03:16,128 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-27 00:03:16,128 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-27 00:03:16,128 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,36739,1695772857140] 2023-09-27 00:03:16,129 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,36739,1695772857140; numProcessing=1 2023-09-27 00:03:16,130 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b457707825e54617b00d3c42370e59d5 2023-09-27 00:03:16,131 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,36739,1695772857140 already deleted, retry=false 2023-09-27 00:03:16,131 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,36739,1695772857140 expired; onlineServers=2 2023-09-27 00:03:16,132 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9e276c86170646049f4fdc351e8cfeca 2023-09-27 00:03:16,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/hbase/acl/cbc027ae1d474285c288d6078456fdb6/l/9e276c86170646049f4fdc351e8cfeca, entries=7, sequenceid=18, filesize=5.2 K 2023-09-27 00:03:16,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for cbc027ae1d474285c288d6078456fdb6 in 41ms, sequenceid=18, compaction requested=false 2023-09-27 00:03:16,140 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/hbase/acl/cbc027ae1d474285c288d6078456fdb6/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-09-27 00:03:16,141 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 00:03:16,141 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1695772859864.cbc027ae1d474285c288d6078456fdb6. 2023-09-27 00:03:16,141 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for cbc027ae1d474285c288d6078456fdb6: 2023-09-27 00:03:16,142 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1695772859864.cbc027ae1d474285c288d6078456fdb6. 2023-09-27 00:03:16,142 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/hbase/meta/1588230740/.tmp/rep_barrier/22492267b4534c64ad6aa87a050871fe 2023-09-27 00:03:16,145 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 22492267b4534c64ad6aa87a050871fe 2023-09-27 00:03:16,156 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/hbase/meta/1588230740/.tmp/table/7300a4ab10664dc2958f92fb23ba322e 2023-09-27 00:03:16,159 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7300a4ab10664dc2958f92fb23ba322e 2023-09-27 00:03:16,160 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-27 00:03:16,160 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-27 00:03:16,160 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/hbase/meta/1588230740/.tmp/info/b457707825e54617b00d3c42370e59d5 as hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/hbase/meta/1588230740/info/b457707825e54617b00d3c42370e59d5 2023-09-27 00:03:16,164 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b457707825e54617b00d3c42370e59d5 2023-09-27 00:03:16,164 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/hbase/meta/1588230740/info/b457707825e54617b00d3c42370e59d5, entries=48, sequenceid=131, filesize=10.3 K 2023-09-27 00:03:16,165 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/hbase/meta/1588230740/.tmp/rep_barrier/22492267b4534c64ad6aa87a050871fe as hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/hbase/meta/1588230740/rep_barrier/22492267b4534c64ad6aa87a050871fe 2023-09-27 00:03:16,168 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 22492267b4534c64ad6aa87a050871fe 2023-09-27 00:03:16,168 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/hbase/meta/1588230740/rep_barrier/22492267b4534c64ad6aa87a050871fe, entries=13, sequenceid=131, filesize=6.4 K 2023-09-27 00:03:16,169 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/hbase/meta/1588230740/.tmp/table/7300a4ab10664dc2958f92fb23ba322e as hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/hbase/meta/1588230740/table/7300a4ab10664dc2958f92fb23ba322e 2023-09-27 00:03:16,173 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7300a4ab10664dc2958f92fb23ba322e 2023-09-27 00:03:16,173 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/hbase/meta/1588230740/table/7300a4ab10664dc2958f92fb23ba322e, entries=24, sequenceid=131, filesize=6.9 K 2023-09-27 00:03:16,174 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 80ms, sequenceid=131, compaction requested=false 2023-09-27 00:03:16,183 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-27 00:03:16,185 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-09-27 00:03:16,186 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 00:03:16,186 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-27 00:03:16,186 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-27 00:03:16,186 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-27 00:03:16,186 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-09-27 00:03:16,229 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-27 00:03:16,229 INFO [RS:2;jenkins-hbase9:36739] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,36739,1695772857140; zookeeper connection closed. 2023-09-27 00:03:16,229 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:36739-0x100eaa1be8f0003, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-27 00:03:16,230 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4f786f86] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4f786f86 2023-09-27 00:03:16,294 INFO [RS:0;jenkins-hbase9:41869] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,41869,1695772857056; all regions closed. 2023-09-27 00:03:16,294 DEBUG [RS:1;jenkins-hbase9:41703] regionserver.HRegionServer(1504): Waiting on 4e820a82ca89c8ef3cf272c45cf6afe2 2023-09-27 00:03:16,299 DEBUG [RS:0;jenkins-hbase9:41869] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/oldWALs 2023-09-27 00:03:16,299 INFO [RS:0;jenkins-hbase9:41869] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C41869%2C1695772857056.meta:.meta(num 1695772858859) 2023-09-27 00:03:16,305 DEBUG [RS:0;jenkins-hbase9:41869] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/oldWALs 2023-09-27 00:03:16,305 INFO [RS:0;jenkins-hbase9:41869] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C41869%2C1695772857056:(num 1695772858672) 2023-09-27 00:03:16,305 DEBUG [RS:0;jenkins-hbase9:41869] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 00:03:16,305 INFO [RS:0;jenkins-hbase9:41869] regionserver.LeaseManager(133): Closed leases 2023-09-27 00:03:16,305 INFO [RS:0;jenkins-hbase9:41869] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-27 00:03:16,306 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-27 00:03:16,306 INFO [RS:0;jenkins-hbase9:41869] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:41869 2023-09-27 00:03:16,308 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:03:16,308 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-27 00:03:16,308 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,41869,1695772857056 2023-09-27 00:03:16,309 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,41869,1695772857056] 2023-09-27 00:03:16,309 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,41869,1695772857056; numProcessing=2 2023-09-27 00:03:16,311 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,41869,1695772857056 already deleted, retry=false 2023-09-27 00:03:16,311 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,41869,1695772857056 expired; onlineServers=1 2023-09-27 00:03:16,409 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-27 00:03:16,409 INFO [RS:0;jenkins-hbase9:41869] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,41869,1695772857056; zookeeper connection closed. 2023-09-27 00:03:16,410 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41869-0x100eaa1be8f0001, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-27 00:03:16,410 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@21677fc9] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@21677fc9 2023-09-27 00:03:16,494 DEBUG [RS:1;jenkins-hbase9:41703] regionserver.HRegionServer(1504): Waiting on 4e820a82ca89c8ef3cf272c45cf6afe2 2023-09-27 00:03:16,510 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-09-27 00:03:16,510 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-09-27 00:03:16,526 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/hbase/namespace/4e820a82ca89c8ef3cf272c45cf6afe2/.tmp/info/49dcf0b472884461a7b54be8acac85c6 2023-09-27 00:03:16,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/hbase/namespace/4e820a82ca89c8ef3cf272c45cf6afe2/.tmp/info/49dcf0b472884461a7b54be8acac85c6 as hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/hbase/namespace/4e820a82ca89c8ef3cf272c45cf6afe2/info/49dcf0b472884461a7b54be8acac85c6 2023-09-27 00:03:16,536 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/hbase/namespace/4e820a82ca89c8ef3cf272c45cf6afe2/info/49dcf0b472884461a7b54be8acac85c6, entries=2, sequenceid=6, filesize=4.8 K 2023-09-27 00:03:16,537 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 4e820a82ca89c8ef3cf272c45cf6afe2 in 445ms, sequenceid=6, compaction requested=false 2023-09-27 00:03:16,542 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/data/hbase/namespace/4e820a82ca89c8ef3cf272c45cf6afe2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 00:03:16,543 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 00:03:16,543 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695772859129.4e820a82ca89c8ef3cf272c45cf6afe2. 2023-09-27 00:03:16,543 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 4e820a82ca89c8ef3cf272c45cf6afe2: 2023-09-27 00:03:16,543 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1695772859129.4e820a82ca89c8ef3cf272c45cf6afe2. 2023-09-27 00:03:16,694 INFO [RS:1;jenkins-hbase9:41703] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,41703,1695772857103; all regions closed. 2023-09-27 00:03:16,700 DEBUG [RS:1;jenkins-hbase9:41703] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/oldWALs 2023-09-27 00:03:16,700 INFO [RS:1;jenkins-hbase9:41703] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C41703%2C1695772857103:(num 1695772858672) 2023-09-27 00:03:16,700 DEBUG [RS:1;jenkins-hbase9:41703] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 00:03:16,700 INFO [RS:1;jenkins-hbase9:41703] regionserver.LeaseManager(133): Closed leases 2023-09-27 00:03:16,700 INFO [RS:1;jenkins-hbase9:41703] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-27 00:03:16,700 INFO [RS:1;jenkins-hbase9:41703] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-27 00:03:16,700 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-27 00:03:16,700 INFO [RS:1;jenkins-hbase9:41703] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-27 00:03:16,701 INFO [RS:1;jenkins-hbase9:41703] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-27 00:03:16,701 INFO [RS:1;jenkins-hbase9:41703] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:41703 2023-09-27 00:03:16,705 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,41703,1695772857103 2023-09-27 00:03:16,705 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-27 00:03:16,707 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,41703,1695772857103] 2023-09-27 00:03:16,707 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,41703,1695772857103; numProcessing=3 2023-09-27 00:03:16,708 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,41703,1695772857103 already deleted, retry=false 2023-09-27 00:03:16,708 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,41703,1695772857103 expired; onlineServers=0 2023-09-27 00:03:16,708 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,33541,1695772855814' ***** 2023-09-27 00:03:16,708 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-09-27 00:03:16,708 DEBUG [M:0;jenkins-hbase9:33541] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2cd17447, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-09-27 00:03:16,708 INFO [M:0;jenkins-hbase9:33541] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,33541,1695772855814 2023-09-27 00:03:16,708 INFO [M:0;jenkins-hbase9:33541] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,33541,1695772855814; all regions closed. 2023-09-27 00:03:16,708 DEBUG [M:0;jenkins-hbase9:33541] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 00:03:16,709 DEBUG [M:0;jenkins-hbase9:33541] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-09-27 00:03:16,709 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-09-27 00:03:16,709 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1695772858327] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1695772858327,5,FailOnTimeoutGroup] 2023-09-27 00:03:16,709 DEBUG [M:0;jenkins-hbase9:33541] cleaner.HFileCleaner(317): Stopping file delete threads 2023-09-27 00:03:16,709 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1695772858328] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1695772858328,5,FailOnTimeoutGroup] 2023-09-27 00:03:16,709 INFO [M:0;jenkins-hbase9:33541] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-09-27 00:03:16,709 INFO [M:0;jenkins-hbase9:33541] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-09-27 00:03:16,709 INFO [M:0;jenkins-hbase9:33541] hbase.ChoreService(369): Chore service for: master/jenkins-hbase9:0 had [] on shutdown 2023-09-27 00:03:16,709 DEBUG [M:0;jenkins-hbase9:33541] master.HMaster(1512): Stopping service threads 2023-09-27 00:03:16,709 INFO [M:0;jenkins-hbase9:33541] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-09-27 00:03:16,709 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-09-27 00:03:16,709 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 00:03:16,709 ERROR [M:0;jenkins-hbase9:33541] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-14,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-09-27 00:03:16,710 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-27 00:03:16,710 INFO [M:0;jenkins-hbase9:33541] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-09-27 00:03:16,710 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-09-27 00:03:16,710 DEBUG [M:0;jenkins-hbase9:33541] zookeeper.ZKUtil(398): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-09-27 00:03:16,710 WARN [M:0;jenkins-hbase9:33541] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-09-27 00:03:16,711 INFO [M:0;jenkins-hbase9:33541] assignment.AssignmentManager(315): Stopping assignment manager 2023-09-27 00:03:16,711 INFO [M:0;jenkins-hbase9:33541] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-09-27 00:03:16,711 DEBUG [M:0;jenkins-hbase9:33541] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-27 00:03:16,711 INFO [M:0;jenkins-hbase9:33541] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-27 00:03:16,711 DEBUG [M:0;jenkins-hbase9:33541] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-27 00:03:16,711 DEBUG [M:0;jenkins-hbase9:33541] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-27 00:03:16,711 DEBUG [M:0;jenkins-hbase9:33541] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-27 00:03:16,711 INFO [M:0;jenkins-hbase9:33541] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.67 KB heapSize=451.96 KB 2023-09-27 00:03:16,723 INFO [M:0;jenkins-hbase9:33541] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.67 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/cab4b2e720334a0ca9474dd0b3fa4aa5 2023-09-27 00:03:16,727 INFO [M:0;jenkins-hbase9:33541] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cab4b2e720334a0ca9474dd0b3fa4aa5 2023-09-27 00:03:16,728 DEBUG [M:0;jenkins-hbase9:33541] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/cab4b2e720334a0ca9474dd0b3fa4aa5 as hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/cab4b2e720334a0ca9474dd0b3fa4aa5 2023-09-27 00:03:16,732 INFO [M:0;jenkins-hbase9:33541] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cab4b2e720334a0ca9474dd0b3fa4aa5 2023-09-27 00:03:16,732 INFO [M:0;jenkins-hbase9:33541] regionserver.HStore(1080): Added hdfs://localhost:40313/user/jenkins/test-data/080ea8dc-aa44-bd3f-6fb1-b7655ddc1ae8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/cab4b2e720334a0ca9474dd0b3fa4aa5, entries=119, sequenceid=899, filesize=28.6 K 2023-09-27 00:03:16,733 INFO [M:0;jenkins-hbase9:33541] regionserver.HRegion(2948): Finished flush of dataSize ~375.67 KB/384690, heapSize ~451.95 KB/462792, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 22ms, sequenceid=899, compaction requested=false 2023-09-27 00:03:16,734 INFO [M:0;jenkins-hbase9:33541] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-27 00:03:16,734 DEBUG [M:0;jenkins-hbase9:33541] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-27 00:03:16,738 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-27 00:03:16,738 INFO [M:0;jenkins-hbase9:33541] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-09-27 00:03:16,739 INFO [M:0;jenkins-hbase9:33541] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:33541 2023-09-27 00:03:16,741 DEBUG [M:0;jenkins-hbase9:33541] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase9.apache.org,33541,1695772855814 already deleted, retry=false 2023-09-27 00:03:16,807 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-27 00:03:16,807 INFO [RS:1;jenkins-hbase9:41703] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,41703,1695772857103; zookeeper connection closed. 2023-09-27 00:03:16,807 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): regionserver:41703-0x100eaa1be8f0002, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-27 00:03:16,807 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5f33eb77] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5f33eb77 2023-09-27 00:03:16,808 INFO [Listener at jenkins-hbase9.apache.org/45033] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-09-27 00:03:16,907 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-27 00:03:16,907 INFO [M:0;jenkins-hbase9:33541] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,33541,1695772855814; zookeeper connection closed. 2023-09-27 00:03:16,907 DEBUG [Listener at localhost/37551-EventThread] zookeeper.ZKWatcher(600): master:33541-0x100eaa1be8f0000, quorum=127.0.0.1:57983, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-27 00:03:16,909 WARN [Listener at jenkins-hbase9.apache.org/45033] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-27 00:03:16,911 INFO [Listener at jenkins-hbase9.apache.org/45033] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-27 00:03:17,015 WARN [BP-387927590-172.31.2.10-1695772852197 heartbeating to localhost/127.0.0.1:40313] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-27 00:03:17,015 WARN [BP-387927590-172.31.2.10-1695772852197 heartbeating to localhost/127.0.0.1:40313] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-387927590-172.31.2.10-1695772852197 (Datanode Uuid 34b95faf-6ce0-4f68-8f0a-b4cd76bb2759) service to localhost/127.0.0.1:40313 2023-09-27 00:03:17,017 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/cluster_7e1535aa-dfbb-2328-367c-8d044f898abe/dfs/data/data5/current/BP-387927590-172.31.2.10-1695772852197] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-27 00:03:17,017 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/cluster_7e1535aa-dfbb-2328-367c-8d044f898abe/dfs/data/data6/current/BP-387927590-172.31.2.10-1695772852197] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-27 00:03:17,018 WARN [Listener at jenkins-hbase9.apache.org/45033] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-27 00:03:17,021 INFO [Listener at jenkins-hbase9.apache.org/45033] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-27 00:03:17,123 WARN [BP-387927590-172.31.2.10-1695772852197 heartbeating to localhost/127.0.0.1:40313] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-27 00:03:17,123 WARN [BP-387927590-172.31.2.10-1695772852197 heartbeating to localhost/127.0.0.1:40313] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-387927590-172.31.2.10-1695772852197 (Datanode Uuid ba0db50a-8e06-4adc-bec3-f536863efcfa) service to localhost/127.0.0.1:40313 2023-09-27 00:03:17,124 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/cluster_7e1535aa-dfbb-2328-367c-8d044f898abe/dfs/data/data3/current/BP-387927590-172.31.2.10-1695772852197] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-27 00:03:17,124 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/cluster_7e1535aa-dfbb-2328-367c-8d044f898abe/dfs/data/data4/current/BP-387927590-172.31.2.10-1695772852197] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-27 00:03:17,126 WARN [Listener at jenkins-hbase9.apache.org/45033] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-27 00:03:17,129 INFO [Listener at jenkins-hbase9.apache.org/45033] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-27 00:03:17,231 WARN [BP-387927590-172.31.2.10-1695772852197 heartbeating to localhost/127.0.0.1:40313] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-27 00:03:17,232 WARN [BP-387927590-172.31.2.10-1695772852197 heartbeating to localhost/127.0.0.1:40313] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-387927590-172.31.2.10-1695772852197 (Datanode Uuid a3301cf4-5fd9-4839-baf3-4ef9d2693182) service to localhost/127.0.0.1:40313 2023-09-27 00:03:17,232 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/cluster_7e1535aa-dfbb-2328-367c-8d044f898abe/dfs/data/data1/current/BP-387927590-172.31.2.10-1695772852197] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-27 00:03:17,233 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d3c33e43-7dc7-01ec-12c6-9e5e94f54d2f/cluster_7e1535aa-dfbb-2328-367c-8d044f898abe/dfs/data/data2/current/BP-387927590-172.31.2.10-1695772852197] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-27 00:03:17,253 INFO [Listener at jenkins-hbase9.apache.org/45033] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-27 00:03:17,378 INFO [Listener at jenkins-hbase9.apache.org/45033] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-09-27 00:03:17,460 INFO [Listener at jenkins-hbase9.apache.org/45033] hbase.HBaseTestingUtility(1293): Minicluster is down