2023-09-27 14:01:06,094 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-09-27 14:01:06,307 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458 2023-09-27 14:01:06,307 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-09-27 14:01:06,307 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-09-27 14:01:06,344 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-09-27 14:01:06,585 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-09-27 14:01:06,586 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/cluster_b497cd91-1a8d-e480-fe2a-873529d0f364, deleteOnExit=true 2023-09-27 14:01:06,586 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-09-27 14:01:06,587 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/test.cache.data in system properties and HBase conf 2023-09-27 14:01:06,588 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/hadoop.tmp.dir in system properties and HBase conf 2023-09-27 14:01:06,588 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/hadoop.log.dir in system properties and HBase conf 2023-09-27 14:01:06,589 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-27 14:01:06,590 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-27 14:01:06,590 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-27 14:01:06,931 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-09-27 14:01:06,936 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-27 14:01:06,937 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-27 14:01:06,937 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-27 14:01:06,937 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-27 14:01:06,938 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-27 14:01:06,938 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-27 14:01:06,938 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-27 14:01:06,939 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-27 14:01:06,939 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-27 14:01:06,940 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/nfs.dump.dir in system properties and HBase conf 2023-09-27 14:01:06,940 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/java.io.tmpdir in system properties and HBase conf 2023-09-27 14:01:06,940 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-27 14:01:06,941 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-27 14:01:06,941 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-09-27 14:01:07,488 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-27 14:01:07,493 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-27 14:01:07,819 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-09-27 14:01:07,983 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-09-27 14:01:07,998 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-27 14:01:08,037 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-09-27 14:01:08,082 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/java.io.tmpdir/Jetty_localhost_38843_hdfs____a6po0s/webapp 2023-09-27 14:01:08,229 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38843 2023-09-27 14:01:08,242 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-27 14:01:08,242 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-27 14:01:08,757 WARN [Listener at localhost/46363] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-27 14:01:08,859 WARN [Listener at localhost/46363] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-27 14:01:08,881 WARN [Listener at localhost/46363] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-27 14:01:08,891 INFO [Listener at localhost/46363] log.Slf4jLog(67): jetty-6.1.26 2023-09-27 14:01:08,901 INFO [Listener at localhost/46363] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/java.io.tmpdir/Jetty_localhost_36989_datanode____.h3ojj6/webapp 2023-09-27 14:01:09,057 INFO [Listener at localhost/46363] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36989 2023-09-27 14:01:09,488 WARN [Listener at localhost/34813] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-27 14:01:09,502 WARN [Listener at localhost/34813] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-27 14:01:09,505 WARN [Listener at localhost/34813] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-27 14:01:09,507 INFO [Listener at localhost/34813] log.Slf4jLog(67): jetty-6.1.26 2023-09-27 14:01:09,513 INFO [Listener at localhost/34813] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/java.io.tmpdir/Jetty_localhost_33525_datanode____.lxbf41/webapp 2023-09-27 14:01:09,614 INFO [Listener at localhost/34813] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33525 2023-09-27 14:01:09,623 WARN [Listener at localhost/40843] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-27 14:01:09,640 WARN [Listener at localhost/40843] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-27 14:01:09,642 WARN [Listener at localhost/40843] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-27 14:01:09,644 INFO [Listener at localhost/40843] log.Slf4jLog(67): jetty-6.1.26 2023-09-27 14:01:09,652 INFO [Listener at localhost/40843] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/java.io.tmpdir/Jetty_localhost_43587_datanode____bm67p8/webapp 2023-09-27 14:01:09,778 INFO [Listener at localhost/40843] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43587 2023-09-27 14:01:09,788 WARN [Listener at localhost/37217] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-27 14:01:10,053 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7a8d6baab423f1af: Processing first storage report for DS-e5f2c05b-d4d2-4296-a1f2-8e4a39b16940 from datanode bffe9dd0-adc8-44ad-afc7-76b0bf5984f6 2023-09-27 14:01:10,055 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7a8d6baab423f1af: from storage DS-e5f2c05b-d4d2-4296-a1f2-8e4a39b16940 node DatanodeRegistration(127.0.0.1:39105, datanodeUuid=bffe9dd0-adc8-44ad-afc7-76b0bf5984f6, infoPort=43567, infoSecurePort=0, ipcPort=34813, storageInfo=lv=-57;cid=testClusterID;nsid=1155747209;c=1695823267578), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-09-27 14:01:10,055 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9d73f97432bf53d2: Processing first storage report for DS-b7e00073-3ef2-4eaa-81e6-acfd63230b71 from datanode c1b54a2b-fdc3-40d0-aa11-413acb262056 2023-09-27 14:01:10,055 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9d73f97432bf53d2: from storage DS-b7e00073-3ef2-4eaa-81e6-acfd63230b71 node DatanodeRegistration(127.0.0.1:38965, datanodeUuid=c1b54a2b-fdc3-40d0-aa11-413acb262056, infoPort=38773, infoSecurePort=0, ipcPort=40843, storageInfo=lv=-57;cid=testClusterID;nsid=1155747209;c=1695823267578), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-09-27 14:01:10,056 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe5cdd3151a4e8fbd: Processing first storage report for DS-e0545a9a-642b-4737-8fa9-b572d3223085 from datanode 4709409f-7736-47f6-af0b-bde70aa66439 2023-09-27 14:01:10,056 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe5cdd3151a4e8fbd: from storage DS-e0545a9a-642b-4737-8fa9-b572d3223085 node DatanodeRegistration(127.0.0.1:38507, datanodeUuid=4709409f-7736-47f6-af0b-bde70aa66439, infoPort=39991, infoSecurePort=0, ipcPort=37217, storageInfo=lv=-57;cid=testClusterID;nsid=1155747209;c=1695823267578), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-27 14:01:10,056 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7a8d6baab423f1af: Processing first storage report for DS-cd8e4d53-42a0-41d7-ada4-0c86cefe22f8 from datanode bffe9dd0-adc8-44ad-afc7-76b0bf5984f6 2023-09-27 14:01:10,056 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7a8d6baab423f1af: from storage DS-cd8e4d53-42a0-41d7-ada4-0c86cefe22f8 node DatanodeRegistration(127.0.0.1:39105, datanodeUuid=bffe9dd0-adc8-44ad-afc7-76b0bf5984f6, infoPort=43567, infoSecurePort=0, ipcPort=34813, storageInfo=lv=-57;cid=testClusterID;nsid=1155747209;c=1695823267578), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-27 14:01:10,056 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9d73f97432bf53d2: Processing first storage report for DS-a65e8f96-0557-48a6-b423-0b0d24b23a6f from datanode c1b54a2b-fdc3-40d0-aa11-413acb262056 2023-09-27 14:01:10,057 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9d73f97432bf53d2: from storage DS-a65e8f96-0557-48a6-b423-0b0d24b23a6f node DatanodeRegistration(127.0.0.1:38965, datanodeUuid=c1b54a2b-fdc3-40d0-aa11-413acb262056, infoPort=38773, infoSecurePort=0, ipcPort=40843, storageInfo=lv=-57;cid=testClusterID;nsid=1155747209;c=1695823267578), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-27 14:01:10,057 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe5cdd3151a4e8fbd: Processing first storage report for DS-cdb715bc-731b-4152-a0c1-a30c6c6d0ad0 from datanode 4709409f-7736-47f6-af0b-bde70aa66439 2023-09-27 14:01:10,057 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe5cdd3151a4e8fbd: from storage DS-cdb715bc-731b-4152-a0c1-a30c6c6d0ad0 node DatanodeRegistration(127.0.0.1:38507, datanodeUuid=4709409f-7736-47f6-af0b-bde70aa66439, infoPort=39991, infoSecurePort=0, ipcPort=37217, storageInfo=lv=-57;cid=testClusterID;nsid=1155747209;c=1695823267578), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-27 14:01:10,268 DEBUG [Listener at localhost/37217] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458 2023-09-27 14:01:10,366 INFO [Listener at localhost/37217] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/cluster_b497cd91-1a8d-e480-fe2a-873529d0f364/zookeeper_0, clientPort=60071, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/cluster_b497cd91-1a8d-e480-fe2a-873529d0f364/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/cluster_b497cd91-1a8d-e480-fe2a-873529d0f364/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-09-27 14:01:10,390 INFO [Listener at localhost/37217] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=60071 2023-09-27 14:01:10,401 INFO [Listener at localhost/37217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 14:01:10,403 INFO [Listener at localhost/37217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 14:01:11,115 INFO [Listener at localhost/37217] util.FSUtils(471): Created version file at hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30 with version=8 2023-09-27 14:01:11,116 INFO [Listener at localhost/37217] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/hbase-staging 2023-09-27 14:01:11,517 INFO [Listener at localhost/37217] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-09-27 14:01:12,015 INFO [Listener at localhost/37217] client.ConnectionUtils(127): master/jenkins-hbase9:0 server-side Connection retries=45 2023-09-27 14:01:12,049 INFO [Listener at localhost/37217] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-27 14:01:12,049 INFO [Listener at localhost/37217] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-27 14:01:12,049 INFO [Listener at localhost/37217] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-27 14:01:12,050 INFO [Listener at localhost/37217] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-27 14:01:12,050 INFO [Listener at localhost/37217] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-27 14:01:12,194 INFO [Listener at localhost/37217] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-09-27 14:01:12,268 DEBUG [Listener at localhost/37217] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-09-27 14:01:12,363 INFO [Listener at localhost/37217] ipc.NettyRpcServer(120): Bind to /172.31.2.10:32789 2023-09-27 14:01:12,377 INFO [Listener at localhost/37217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 14:01:12,379 INFO [Listener at localhost/37217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 14:01:12,403 INFO [Listener at localhost/37217] zookeeper.RecoverableZooKeeper(93): Process identifier=master:32789 connecting to ZooKeeper ensemble=127.0.0.1:60071 2023-09-27 14:01:12,462 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:327890x0, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-27 14:01:12,465 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:32789-0x100eda3061c0000 connected 2023-09-27 14:01:12,497 DEBUG [Listener at localhost/37217] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-27 14:01:12,498 DEBUG [Listener at localhost/37217] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-27 14:01:12,513 DEBUG [Listener at localhost/37217] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-27 14:01:12,522 DEBUG [Listener at localhost/37217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=32789 2023-09-27 14:01:12,522 DEBUG [Listener at localhost/37217] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=32789 2023-09-27 14:01:12,523 DEBUG [Listener at localhost/37217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=32789 2023-09-27 14:01:12,523 DEBUG [Listener at localhost/37217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=32789 2023-09-27 14:01:12,524 DEBUG [Listener at localhost/37217] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=32789 2023-09-27 14:01:12,533 INFO [Listener at localhost/37217] master.HMaster(444): hbase.rootdir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30, hbase.cluster.distributed=false 2023-09-27 14:01:12,609 INFO [Listener at localhost/37217] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-09-27 14:01:12,609 INFO [Listener at localhost/37217] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-27 14:01:12,609 INFO [Listener at localhost/37217] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-27 14:01:12,610 INFO [Listener at localhost/37217] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-27 14:01:12,610 INFO [Listener at localhost/37217] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-27 14:01:12,610 INFO [Listener at localhost/37217] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-27 14:01:12,615 INFO [Listener at localhost/37217] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-27 14:01:12,618 INFO [Listener at localhost/37217] ipc.NettyRpcServer(120): Bind to /172.31.2.10:43797 2023-09-27 14:01:12,621 INFO [Listener at localhost/37217] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-27 14:01:12,629 INFO [Listener at localhost/37217] mob.MobFileCache(124): MobFileCache disabled 2023-09-27 14:01:12,630 INFO [Listener at localhost/37217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 14:01:12,633 INFO [Listener at localhost/37217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 14:01:12,635 INFO [Listener at localhost/37217] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43797 connecting to ZooKeeper ensemble=127.0.0.1:60071 2023-09-27 14:01:12,640 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:437970x0, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-27 14:01:12,641 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43797-0x100eda3061c0001 connected 2023-09-27 14:01:12,641 DEBUG [Listener at localhost/37217] zookeeper.ZKUtil(164): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-27 14:01:12,643 DEBUG [Listener at localhost/37217] zookeeper.ZKUtil(164): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-27 14:01:12,644 DEBUG [Listener at localhost/37217] zookeeper.ZKUtil(164): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-27 14:01:12,645 DEBUG [Listener at localhost/37217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43797 2023-09-27 14:01:12,647 DEBUG [Listener at localhost/37217] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43797 2023-09-27 14:01:12,648 DEBUG [Listener at localhost/37217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43797 2023-09-27 14:01:12,648 DEBUG [Listener at localhost/37217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43797 2023-09-27 14:01:12,648 DEBUG [Listener at localhost/37217] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43797 2023-09-27 14:01:12,662 INFO [Listener at localhost/37217] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-09-27 14:01:12,662 INFO [Listener at localhost/37217] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-27 14:01:12,663 INFO [Listener at localhost/37217] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-27 14:01:12,663 INFO [Listener at localhost/37217] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-27 14:01:12,664 INFO [Listener at localhost/37217] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-27 14:01:12,664 INFO [Listener at localhost/37217] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-27 14:01:12,664 INFO [Listener at localhost/37217] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-27 14:01:12,669 INFO [Listener at localhost/37217] ipc.NettyRpcServer(120): Bind to /172.31.2.10:33659 2023-09-27 14:01:12,669 INFO [Listener at localhost/37217] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-27 14:01:12,670 INFO [Listener at localhost/37217] mob.MobFileCache(124): MobFileCache disabled 2023-09-27 14:01:12,671 INFO [Listener at localhost/37217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 14:01:12,675 INFO [Listener at localhost/37217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 14:01:12,678 INFO [Listener at localhost/37217] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33659 connecting to ZooKeeper ensemble=127.0.0.1:60071 2023-09-27 14:01:12,682 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:336590x0, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-27 14:01:12,683 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:33659-0x100eda3061c0002 connected 2023-09-27 14:01:12,683 DEBUG [Listener at localhost/37217] zookeeper.ZKUtil(164): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-27 14:01:12,684 DEBUG [Listener at localhost/37217] zookeeper.ZKUtil(164): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-27 14:01:12,685 DEBUG [Listener at localhost/37217] zookeeper.ZKUtil(164): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-27 14:01:12,688 DEBUG [Listener at localhost/37217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33659 2023-09-27 14:01:12,689 DEBUG [Listener at localhost/37217] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33659 2023-09-27 14:01:12,689 DEBUG [Listener at localhost/37217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33659 2023-09-27 14:01:12,690 DEBUG [Listener at localhost/37217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33659 2023-09-27 14:01:12,691 DEBUG [Listener at localhost/37217] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33659 2023-09-27 14:01:12,703 INFO [Listener at localhost/37217] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-09-27 14:01:12,703 INFO [Listener at localhost/37217] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-27 14:01:12,703 INFO [Listener at localhost/37217] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-27 14:01:12,703 INFO [Listener at localhost/37217] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-27 14:01:12,704 INFO [Listener at localhost/37217] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-27 14:01:12,704 INFO [Listener at localhost/37217] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-27 14:01:12,704 INFO [Listener at localhost/37217] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-27 14:01:12,707 INFO [Listener at localhost/37217] ipc.NettyRpcServer(120): Bind to /172.31.2.10:44379 2023-09-27 14:01:12,707 INFO [Listener at localhost/37217] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-27 14:01:12,708 INFO [Listener at localhost/37217] mob.MobFileCache(124): MobFileCache disabled 2023-09-27 14:01:12,709 INFO [Listener at localhost/37217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 14:01:12,711 INFO [Listener at localhost/37217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 14:01:12,712 INFO [Listener at localhost/37217] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44379 connecting to ZooKeeper ensemble=127.0.0.1:60071 2023-09-27 14:01:12,716 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:443790x0, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-27 14:01:12,717 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44379-0x100eda3061c0003 connected 2023-09-27 14:01:12,717 DEBUG [Listener at localhost/37217] zookeeper.ZKUtil(164): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-27 14:01:12,718 DEBUG [Listener at localhost/37217] zookeeper.ZKUtil(164): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-27 14:01:12,719 DEBUG [Listener at localhost/37217] zookeeper.ZKUtil(164): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-27 14:01:12,726 DEBUG [Listener at localhost/37217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44379 2023-09-27 14:01:12,726 DEBUG [Listener at localhost/37217] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44379 2023-09-27 14:01:12,726 DEBUG [Listener at localhost/37217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44379 2023-09-27 14:01:12,727 DEBUG [Listener at localhost/37217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44379 2023-09-27 14:01:12,727 DEBUG [Listener at localhost/37217] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44379 2023-09-27 14:01:12,729 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase9.apache.org,32789,1695823271327 2023-09-27 14:01:12,739 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-27 14:01:12,741 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase9.apache.org,32789,1695823271327 2023-09-27 14:01:12,762 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-27 14:01:12,762 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-27 14:01:12,762 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-27 14:01:12,762 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-27 14:01:12,763 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 14:01:12,765 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-27 14:01:12,766 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase9.apache.org,32789,1695823271327 from backup master directory 2023-09-27 14:01:12,766 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-27 14:01:12,771 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase9.apache.org,32789,1695823271327 2023-09-27 14:01:12,771 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-27 14:01:12,772 WARN [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-27 14:01:12,772 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase9.apache.org,32789,1695823271327 2023-09-27 14:01:12,776 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-09-27 14:01:12,778 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-09-27 14:01:12,881 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/hbase.id with ID: 953a5815-6f6f-4521-99fc-5c614ff1d851 2023-09-27 14:01:12,923 INFO [master/jenkins-hbase9:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 14:01:12,941 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 14:01:13,001 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x6f37cb58 to 127.0.0.1:60071 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 14:01:13,036 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@683dd118, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 14:01:13,062 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-27 14:01:13,064 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-09-27 14:01:13,082 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-09-27 14:01:13,083 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-09-27 14:01:13,085 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-27 14:01:13,089 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-27 14:01:13,091 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-27 14:01:13,129 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/MasterData/data/master/store-tmp 2023-09-27 14:01:13,169 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 14:01:13,169 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-27 14:01:13,169 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-27 14:01:13,169 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-27 14:01:13,169 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-27 14:01:13,169 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-27 14:01:13,170 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-27 14:01:13,170 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-27 14:01:13,171 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/MasterData/WALs/jenkins-hbase9.apache.org,32789,1695823271327 2023-09-27 14:01:13,195 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C32789%2C1695823271327, suffix=, logDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/MasterData/WALs/jenkins-hbase9.apache.org,32789,1695823271327, archiveDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/MasterData/oldWALs, maxLogs=10 2023-09-27 14:01:13,259 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38507,DS-e0545a9a-642b-4737-8fa9-b572d3223085,DISK] 2023-09-27 14:01:13,259 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39105,DS-e5f2c05b-d4d2-4296-a1f2-8e4a39b16940,DISK] 2023-09-27 14:01:13,259 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38965,DS-b7e00073-3ef2-4eaa-81e6-acfd63230b71,DISK] 2023-09-27 14:01:13,272 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-09-27 14:01:13,337 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/MasterData/WALs/jenkins-hbase9.apache.org,32789,1695823271327/jenkins-hbase9.apache.org%2C32789%2C1695823271327.1695823273207 2023-09-27 14:01:13,337 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38965,DS-b7e00073-3ef2-4eaa-81e6-acfd63230b71,DISK], DatanodeInfoWithStorage[127.0.0.1:38507,DS-e0545a9a-642b-4737-8fa9-b572d3223085,DISK], DatanodeInfoWithStorage[127.0.0.1:39105,DS-e5f2c05b-d4d2-4296-a1f2-8e4a39b16940,DISK]] 2023-09-27 14:01:13,338 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-09-27 14:01:13,338 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 14:01:13,342 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-09-27 14:01:13,343 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-09-27 14:01:13,406 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-09-27 14:01:13,413 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-09-27 14:01:13,441 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-09-27 14:01:13,457 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 14:01:13,464 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-27 14:01:13,466 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-27 14:01:13,481 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-09-27 14:01:13,486 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 14:01:13,487 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66788550, jitterRate=-0.004773050546646118}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 14:01:13,487 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-27 14:01:13,488 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-09-27 14:01:13,511 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-09-27 14:01:13,511 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-09-27 14:01:13,514 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-09-27 14:01:13,516 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-09-27 14:01:13,553 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 36 msec 2023-09-27 14:01:13,553 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-09-27 14:01:13,583 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-09-27 14:01:13,588 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-09-27 14:01:13,615 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-09-27 14:01:13,620 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-09-27 14:01:13,622 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-09-27 14:01:13,625 INFO [master/jenkins-hbase9:0:becomeActiveMaster] normalizer.SimpleRegionNormalizer(156): Updated configuration for key 'hbase.normalizer.merge.merge_request_max_number_of_regions' from 100 to 50 2023-09-27 14:01:13,628 INFO [master/jenkins-hbase9:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-09-27 14:01:13,632 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-09-27 14:01:13,636 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 14:01:13,638 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-09-27 14:01:13,638 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-09-27 14:01:13,652 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-09-27 14:01:13,656 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-27 14:01:13,656 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-27 14:01:13,656 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-27 14:01:13,656 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-27 14:01:13,657 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 14:01:13,657 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase9.apache.org,32789,1695823271327, sessionid=0x100eda3061c0000, setting cluster-up flag (Was=false) 2023-09-27 14:01:13,675 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 14:01:13,681 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-09-27 14:01:13,682 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,32789,1695823271327 2023-09-27 14:01:13,688 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 14:01:13,693 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-09-27 14:01:13,695 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,32789,1695823271327 2023-09-27 14:01:13,698 WARN [master/jenkins-hbase9:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp 2023-09-27 14:01:13,732 INFO [RS:1;jenkins-hbase9:33659] regionserver.HRegionServer(951): ClusterId : 953a5815-6f6f-4521-99fc-5c614ff1d851 2023-09-27 14:01:13,733 INFO [RS:0;jenkins-hbase9:43797] regionserver.HRegionServer(951): ClusterId : 953a5815-6f6f-4521-99fc-5c614ff1d851 2023-09-27 14:01:13,732 INFO [RS:2;jenkins-hbase9:44379] regionserver.HRegionServer(951): ClusterId : 953a5815-6f6f-4521-99fc-5c614ff1d851 2023-09-27 14:01:13,739 DEBUG [RS:2;jenkins-hbase9:44379] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-27 14:01:13,739 DEBUG [RS:0;jenkins-hbase9:43797] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-27 14:01:13,739 DEBUG [RS:1;jenkins-hbase9:33659] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-27 14:01:13,747 DEBUG [RS:2;jenkins-hbase9:44379] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-27 14:01:13,747 DEBUG [RS:1;jenkins-hbase9:33659] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-27 14:01:13,747 DEBUG [RS:0;jenkins-hbase9:43797] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-27 14:01:13,748 DEBUG [RS:1;jenkins-hbase9:33659] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-27 14:01:13,748 DEBUG [RS:2;jenkins-hbase9:44379] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-27 14:01:13,748 DEBUG [RS:0;jenkins-hbase9:43797] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-27 14:01:13,752 DEBUG [RS:2;jenkins-hbase9:44379] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-27 14:01:13,753 DEBUG [RS:1;jenkins-hbase9:33659] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-27 14:01:13,754 DEBUG [RS:0;jenkins-hbase9:43797] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-27 14:01:13,756 DEBUG [RS:2;jenkins-hbase9:44379] zookeeper.ReadOnlyZKClient(139): Connect 0x6bd43af5 to 127.0.0.1:60071 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 14:01:13,757 DEBUG [RS:1;jenkins-hbase9:33659] zookeeper.ReadOnlyZKClient(139): Connect 0x01730409 to 127.0.0.1:60071 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 14:01:13,757 DEBUG [RS:0;jenkins-hbase9:43797] zookeeper.ReadOnlyZKClient(139): Connect 0x61c5abb0 to 127.0.0.1:60071 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 14:01:13,768 DEBUG [RS:2;jenkins-hbase9:44379] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6513c9ff, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 14:01:13,768 DEBUG [RS:2;jenkins-hbase9:44379] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@612c5185, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-09-27 14:01:13,783 DEBUG [RS:1;jenkins-hbase9:33659] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@fb4ea57, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 14:01:13,783 DEBUG [RS:1;jenkins-hbase9:33659] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b8b6f79, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-09-27 14:01:13,783 DEBUG [RS:0;jenkins-hbase9:43797] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f0259f8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 14:01:13,784 DEBUG [RS:0;jenkins-hbase9:43797] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b3dc0c0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-09-27 14:01:13,805 DEBUG [RS:1;jenkins-hbase9:33659] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase9:33659 2023-09-27 14:01:13,805 DEBUG [RS:2;jenkins-hbase9:44379] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase9:44379 2023-09-27 14:01:13,808 DEBUG [RS:0;jenkins-hbase9:43797] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase9:43797 2023-09-27 14:01:13,810 INFO [RS:1;jenkins-hbase9:33659] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-27 14:01:13,810 INFO [RS:0;jenkins-hbase9:43797] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-27 14:01:13,810 INFO [RS:2;jenkins-hbase9:44379] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-27 14:01:13,810 INFO [RS:0;jenkins-hbase9:43797] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-27 14:01:13,810 INFO [RS:1;jenkins-hbase9:33659] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-27 14:01:13,810 INFO [RS:2;jenkins-hbase9:44379] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-27 14:01:13,836 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-09-27 14:01:13,836 DEBUG [RS:2;jenkins-hbase9:44379] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-27 14:01:13,836 DEBUG [RS:0;jenkins-hbase9:43797] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-27 14:01:13,836 DEBUG [RS:1;jenkins-hbase9:33659] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-27 14:01:13,837 INFO [RS:1;jenkins-hbase9:33659] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 14:01:13,838 DEBUG [RS:1;jenkins-hbase9:33659] regionserver.HRegionServer(1022): About to register with Master. 2023-09-27 14:01:13,838 INFO [RS:2;jenkins-hbase9:44379] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 14:01:13,838 INFO [RS:0;jenkins-hbase9:43797] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 14:01:13,839 DEBUG [RS:0;jenkins-hbase9:43797] regionserver.HRegionServer(1022): About to register with Master. 2023-09-27 14:01:13,838 INFO [master/jenkins-hbase9:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 14:01:13,838 DEBUG [RS:2;jenkins-hbase9:44379] regionserver.HRegionServer(1022): About to register with Master. 2023-09-27 14:01:13,839 INFO [master/jenkins-hbase9:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-09-27 14:01:13,842 INFO [RS:2;jenkins-hbase9:44379] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,32789,1695823271327 with isa=jenkins-hbase9.apache.org/172.31.2.10:44379, startcode=1695823272702 2023-09-27 14:01:13,842 INFO [RS:0;jenkins-hbase9:43797] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,32789,1695823271327 with isa=jenkins-hbase9.apache.org/172.31.2.10:43797, startcode=1695823272608 2023-09-27 14:01:13,842 INFO [RS:1;jenkins-hbase9:33659] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,32789,1695823271327 with isa=jenkins-hbase9.apache.org/172.31.2.10:33659, startcode=1695823272661 2023-09-27 14:01:13,860 DEBUG [RS:1;jenkins-hbase9:33659] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-27 14:01:13,860 DEBUG [RS:0;jenkins-hbase9:43797] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-27 14:01:13,860 DEBUG [RS:2;jenkins-hbase9:44379] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-27 14:01:13,918 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:32839, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-09-27 14:01:13,918 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:56233, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-09-27 14:01:13,918 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:59171, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-09-27 14:01:13,930 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32789] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-27 14:01:13,941 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32789] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-27 14:01:13,942 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32789] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-27 14:01:13,945 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-09-27 14:01:13,958 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-09-27 14:01:13,958 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-09-27 14:01:13,959 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-09-27 14:01:13,959 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-09-27 14:01:13,959 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase9:0, corePoolSize=10, maxPoolSize=10 2023-09-27 14:01:13,959 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 14:01:13,959 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-09-27 14:01:13,959 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 14:01:13,960 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1695823303960 2023-09-27 14:01:13,962 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-09-27 14:01:13,964 DEBUG [RS:0;jenkins-hbase9:43797] regionserver.HRegionServer(2830): Master is not running yet 2023-09-27 14:01:13,964 DEBUG [RS:2;jenkins-hbase9:44379] regionserver.HRegionServer(2830): Master is not running yet 2023-09-27 14:01:13,964 WARN [RS:0;jenkins-hbase9:43797] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-27 14:01:13,964 DEBUG [RS:1;jenkins-hbase9:33659] regionserver.HRegionServer(2830): Master is not running yet 2023-09-27 14:01:13,964 WARN [RS:2;jenkins-hbase9:44379] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-27 14:01:13,964 WARN [RS:1;jenkins-hbase9:33659] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-27 14:01:13,967 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-09-27 14:01:13,968 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-09-27 14:01:13,972 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-27 14:01:13,973 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-09-27 14:01:13,980 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-09-27 14:01:13,980 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-09-27 14:01:13,981 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-09-27 14:01:13,981 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-09-27 14:01:13,981 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-27 14:01:13,983 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-09-27 14:01:13,984 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-09-27 14:01:13,985 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-09-27 14:01:13,987 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-09-27 14:01:13,988 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-09-27 14:01:13,989 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1695823273989,5,FailOnTimeoutGroup] 2023-09-27 14:01:13,990 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1695823273990,5,FailOnTimeoutGroup] 2023-09-27 14:01:13,990 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-27 14:01:13,990 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-09-27 14:01:13,991 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-09-27 14:01:13,992 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-09-27 14:01:14,011 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-27 14:01:14,013 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-27 14:01:14,013 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30 2023-09-27 14:01:14,036 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 14:01:14,038 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-27 14:01:14,041 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/hbase/meta/1588230740/info 2023-09-27 14:01:14,042 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-27 14:01:14,043 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 14:01:14,043 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-27 14:01:14,045 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/hbase/meta/1588230740/rep_barrier 2023-09-27 14:01:14,046 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-27 14:01:14,046 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 14:01:14,047 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-27 14:01:14,049 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/hbase/meta/1588230740/table 2023-09-27 14:01:14,049 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-27 14:01:14,050 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 14:01:14,051 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/hbase/meta/1588230740 2023-09-27 14:01:14,052 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/hbase/meta/1588230740 2023-09-27 14:01:14,056 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-27 14:01:14,058 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-27 14:01:14,064 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 14:01:14,065 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61398810, jitterRate=-0.08508643507957458}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-27 14:01:14,065 INFO [RS:0;jenkins-hbase9:43797] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,32789,1695823271327 with isa=jenkins-hbase9.apache.org/172.31.2.10:43797, startcode=1695823272608 2023-09-27 14:01:14,065 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-27 14:01:14,065 INFO [RS:2;jenkins-hbase9:44379] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,32789,1695823271327 with isa=jenkins-hbase9.apache.org/172.31.2.10:44379, startcode=1695823272702 2023-09-27 14:01:14,066 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-27 14:01:14,066 INFO [RS:1;jenkins-hbase9:33659] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,32789,1695823271327 with isa=jenkins-hbase9.apache.org/172.31.2.10:33659, startcode=1695823272661 2023-09-27 14:01:14,066 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-27 14:01:14,066 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-27 14:01:14,066 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-27 14:01:14,066 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-27 14:01:14,069 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-27 14:01:14,070 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-27 14:01:14,078 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32789] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:14,079 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-09-27 14:01:14,079 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-09-27 14:01:14,086 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32789] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:14,087 DEBUG [RS:1;jenkins-hbase9:33659] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30 2023-09-27 14:01:14,087 DEBUG [RS:1;jenkins-hbase9:33659] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:46363 2023-09-27 14:01:14,087 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32789] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:14,087 DEBUG [RS:1;jenkins-hbase9:33659] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-27 14:01:14,088 DEBUG [RS:0;jenkins-hbase9:43797] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30 2023-09-27 14:01:14,088 DEBUG [RS:0;jenkins-hbase9:43797] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:46363 2023-09-27 14:01:14,088 DEBUG [RS:0;jenkins-hbase9:43797] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-27 14:01:14,089 DEBUG [RS:2;jenkins-hbase9:44379] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30 2023-09-27 14:01:14,089 DEBUG [RS:2;jenkins-hbase9:44379] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:46363 2023-09-27 14:01:14,090 DEBUG [RS:2;jenkins-hbase9:44379] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-27 14:01:14,092 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-09-27 14:01:14,096 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-27 14:01:14,101 DEBUG [RS:0;jenkins-hbase9:43797] zookeeper.ZKUtil(162): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:14,102 WARN [RS:0;jenkins-hbase9:43797] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-27 14:01:14,102 INFO [RS:0;jenkins-hbase9:43797] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-27 14:01:14,102 DEBUG [RS:0;jenkins-hbase9:43797] regionserver.HRegionServer(1948): logDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/WALs/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:14,102 DEBUG [RS:2;jenkins-hbase9:44379] zookeeper.ZKUtil(162): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:14,102 WARN [RS:2;jenkins-hbase9:44379] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-27 14:01:14,103 INFO [RS:2;jenkins-hbase9:44379] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-27 14:01:14,103 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,43797,1695823272608] 2023-09-27 14:01:14,103 DEBUG [RS:2;jenkins-hbase9:44379] regionserver.HRegionServer(1948): logDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/WALs/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:14,103 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,44379,1695823272702] 2023-09-27 14:01:14,104 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,33659,1695823272661] 2023-09-27 14:01:14,104 DEBUG [RS:1;jenkins-hbase9:33659] zookeeper.ZKUtil(162): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:14,104 WARN [RS:1;jenkins-hbase9:33659] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-27 14:01:14,104 INFO [RS:1;jenkins-hbase9:33659] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-27 14:01:14,105 DEBUG [RS:1;jenkins-hbase9:33659] regionserver.HRegionServer(1948): logDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/WALs/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:14,119 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-09-27 14:01:14,122 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-09-27 14:01:14,125 DEBUG [RS:0;jenkins-hbase9:43797] zookeeper.ZKUtil(162): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:14,125 DEBUG [RS:1;jenkins-hbase9:33659] zookeeper.ZKUtil(162): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:14,125 DEBUG [RS:2;jenkins-hbase9:44379] zookeeper.ZKUtil(162): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:14,126 DEBUG [RS:0;jenkins-hbase9:43797] zookeeper.ZKUtil(162): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:14,126 DEBUG [RS:1;jenkins-hbase9:33659] zookeeper.ZKUtil(162): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:14,126 DEBUG [RS:2;jenkins-hbase9:44379] zookeeper.ZKUtil(162): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:14,126 DEBUG [RS:0;jenkins-hbase9:43797] zookeeper.ZKUtil(162): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:14,126 DEBUG [RS:1;jenkins-hbase9:33659] zookeeper.ZKUtil(162): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:14,126 DEBUG [RS:2;jenkins-hbase9:44379] zookeeper.ZKUtil(162): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:14,138 DEBUG [RS:1;jenkins-hbase9:33659] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-27 14:01:14,138 DEBUG [RS:0;jenkins-hbase9:43797] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-27 14:01:14,138 DEBUG [RS:2;jenkins-hbase9:44379] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-27 14:01:14,148 INFO [RS:1;jenkins-hbase9:33659] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-27 14:01:14,149 INFO [RS:0;jenkins-hbase9:43797] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-27 14:01:14,148 INFO [RS:2;jenkins-hbase9:44379] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-27 14:01:14,170 INFO [RS:1;jenkins-hbase9:33659] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-27 14:01:14,170 INFO [RS:0;jenkins-hbase9:43797] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-27 14:01:14,170 INFO [RS:2;jenkins-hbase9:44379] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-27 14:01:14,175 INFO [RS:1;jenkins-hbase9:33659] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-27 14:01:14,175 INFO [RS:2;jenkins-hbase9:44379] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-27 14:01:14,176 INFO [RS:1;jenkins-hbase9:33659] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-27 14:01:14,175 INFO [RS:0;jenkins-hbase9:43797] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-27 14:01:14,176 INFO [RS:2;jenkins-hbase9:44379] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-27 14:01:14,177 INFO [RS:0;jenkins-hbase9:43797] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-27 14:01:14,177 INFO [RS:1;jenkins-hbase9:33659] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-27 14:01:14,177 INFO [RS:2;jenkins-hbase9:44379] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-27 14:01:14,178 INFO [RS:0;jenkins-hbase9:43797] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-27 14:01:14,186 INFO [RS:0;jenkins-hbase9:43797] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-27 14:01:14,186 INFO [RS:1;jenkins-hbase9:33659] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-27 14:01:14,186 INFO [RS:2;jenkins-hbase9:44379] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-27 14:01:14,186 DEBUG [RS:0;jenkins-hbase9:43797] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 14:01:14,187 DEBUG [RS:1;jenkins-hbase9:33659] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 14:01:14,187 DEBUG [RS:0;jenkins-hbase9:43797] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 14:01:14,187 DEBUG [RS:1;jenkins-hbase9:33659] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 14:01:14,187 DEBUG [RS:0;jenkins-hbase9:43797] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 14:01:14,187 DEBUG [RS:1;jenkins-hbase9:33659] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 14:01:14,187 DEBUG [RS:0;jenkins-hbase9:43797] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 14:01:14,187 DEBUG [RS:1;jenkins-hbase9:33659] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 14:01:14,187 DEBUG [RS:0;jenkins-hbase9:43797] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 14:01:14,187 DEBUG [RS:1;jenkins-hbase9:33659] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 14:01:14,187 DEBUG [RS:0;jenkins-hbase9:43797] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-09-27 14:01:14,187 DEBUG [RS:2;jenkins-hbase9:44379] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 14:01:14,187 DEBUG [RS:0;jenkins-hbase9:43797] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 14:01:14,187 DEBUG [RS:1;jenkins-hbase9:33659] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-09-27 14:01:14,188 DEBUG [RS:2;jenkins-hbase9:44379] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 14:01:14,188 DEBUG [RS:1;jenkins-hbase9:33659] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 14:01:14,188 DEBUG [RS:0;jenkins-hbase9:43797] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 14:01:14,188 DEBUG [RS:1;jenkins-hbase9:33659] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 14:01:14,188 DEBUG [RS:0;jenkins-hbase9:43797] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 14:01:14,188 DEBUG [RS:1;jenkins-hbase9:33659] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 14:01:14,188 DEBUG [RS:0;jenkins-hbase9:43797] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 14:01:14,188 DEBUG [RS:1;jenkins-hbase9:33659] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 14:01:14,188 DEBUG [RS:2;jenkins-hbase9:44379] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 14:01:14,188 DEBUG [RS:2;jenkins-hbase9:44379] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 14:01:14,188 DEBUG [RS:2;jenkins-hbase9:44379] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 14:01:14,189 DEBUG [RS:2;jenkins-hbase9:44379] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-09-27 14:01:14,189 DEBUG [RS:2;jenkins-hbase9:44379] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 14:01:14,189 DEBUG [RS:2;jenkins-hbase9:44379] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 14:01:14,189 DEBUG [RS:2;jenkins-hbase9:44379] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 14:01:14,190 DEBUG [RS:2;jenkins-hbase9:44379] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-27 14:01:14,190 INFO [RS:0;jenkins-hbase9:43797] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-27 14:01:14,192 INFO [RS:0;jenkins-hbase9:43797] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-27 14:01:14,193 INFO [RS:0;jenkins-hbase9:43797] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-27 14:01:14,193 INFO [RS:1;jenkins-hbase9:33659] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-27 14:01:14,193 INFO [RS:1;jenkins-hbase9:33659] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-27 14:01:14,193 INFO [RS:1;jenkins-hbase9:33659] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-27 14:01:14,196 INFO [RS:2;jenkins-hbase9:44379] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-27 14:01:14,196 INFO [RS:2;jenkins-hbase9:44379] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-27 14:01:14,196 INFO [RS:2;jenkins-hbase9:44379] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-27 14:01:14,214 INFO [RS:2;jenkins-hbase9:44379] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-27 14:01:14,214 INFO [RS:0;jenkins-hbase9:43797] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-27 14:01:14,214 INFO [RS:1;jenkins-hbase9:33659] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-27 14:01:14,218 INFO [RS:2;jenkins-hbase9:44379] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,44379,1695823272702-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-27 14:01:14,218 INFO [RS:1;jenkins-hbase9:33659] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,33659,1695823272661-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-27 14:01:14,218 INFO [RS:0;jenkins-hbase9:43797] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,43797,1695823272608-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-27 14:01:14,238 INFO [RS:1;jenkins-hbase9:33659] regionserver.Replication(203): jenkins-hbase9.apache.org,33659,1695823272661 started 2023-09-27 14:01:14,238 INFO [RS:1;jenkins-hbase9:33659] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,33659,1695823272661, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:33659, sessionid=0x100eda3061c0002 2023-09-27 14:01:14,239 DEBUG [RS:1;jenkins-hbase9:33659] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-27 14:01:14,239 DEBUG [RS:1;jenkins-hbase9:33659] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:14,239 DEBUG [RS:1;jenkins-hbase9:33659] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,33659,1695823272661' 2023-09-27 14:01:14,239 DEBUG [RS:1;jenkins-hbase9:33659] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-27 14:01:14,240 DEBUG [RS:1;jenkins-hbase9:33659] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-27 14:01:14,240 DEBUG [RS:1;jenkins-hbase9:33659] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-27 14:01:14,240 DEBUG [RS:1;jenkins-hbase9:33659] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-27 14:01:14,240 DEBUG [RS:1;jenkins-hbase9:33659] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:14,240 DEBUG [RS:1;jenkins-hbase9:33659] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,33659,1695823272661' 2023-09-27 14:01:14,240 DEBUG [RS:1;jenkins-hbase9:33659] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:01:14,241 INFO [RS:0;jenkins-hbase9:43797] regionserver.Replication(203): jenkins-hbase9.apache.org,43797,1695823272608 started 2023-09-27 14:01:14,241 DEBUG [RS:1;jenkins-hbase9:33659] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:01:14,241 INFO [RS:0;jenkins-hbase9:43797] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,43797,1695823272608, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:43797, sessionid=0x100eda3061c0001 2023-09-27 14:01:14,241 INFO [RS:2;jenkins-hbase9:44379] regionserver.Replication(203): jenkins-hbase9.apache.org,44379,1695823272702 started 2023-09-27 14:01:14,241 DEBUG [RS:0;jenkins-hbase9:43797] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-27 14:01:14,241 INFO [RS:2;jenkins-hbase9:44379] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,44379,1695823272702, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:44379, sessionid=0x100eda3061c0003 2023-09-27 14:01:14,241 DEBUG [RS:1;jenkins-hbase9:33659] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-27 14:01:14,242 DEBUG [RS:2;jenkins-hbase9:44379] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-27 14:01:14,242 INFO [RS:1;jenkins-hbase9:33659] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-27 14:01:14,241 DEBUG [RS:0;jenkins-hbase9:43797] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:14,242 INFO [RS:1;jenkins-hbase9:33659] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-27 14:01:14,242 DEBUG [RS:2;jenkins-hbase9:44379] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:14,243 DEBUG [RS:0;jenkins-hbase9:43797] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,43797,1695823272608' 2023-09-27 14:01:14,243 DEBUG [RS:2;jenkins-hbase9:44379] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,44379,1695823272702' 2023-09-27 14:01:14,243 DEBUG [RS:0;jenkins-hbase9:43797] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-27 14:01:14,243 DEBUG [RS:2;jenkins-hbase9:44379] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-27 14:01:14,244 DEBUG [RS:0;jenkins-hbase9:43797] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-27 14:01:14,244 DEBUG [RS:2;jenkins-hbase9:44379] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-27 14:01:14,244 DEBUG [RS:0;jenkins-hbase9:43797] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-27 14:01:14,244 DEBUG [RS:2;jenkins-hbase9:44379] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-27 14:01:14,244 DEBUG [RS:0;jenkins-hbase9:43797] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-27 14:01:14,245 DEBUG [RS:2;jenkins-hbase9:44379] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-27 14:01:14,245 DEBUG [RS:2;jenkins-hbase9:44379] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:14,245 DEBUG [RS:0;jenkins-hbase9:43797] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:14,245 DEBUG [RS:0;jenkins-hbase9:43797] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,43797,1695823272608' 2023-09-27 14:01:14,245 DEBUG [RS:2;jenkins-hbase9:44379] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,44379,1695823272702' 2023-09-27 14:01:14,246 DEBUG [RS:2;jenkins-hbase9:44379] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:01:14,245 DEBUG [RS:0;jenkins-hbase9:43797] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:01:14,246 DEBUG [RS:2;jenkins-hbase9:44379] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:01:14,246 DEBUG [RS:0;jenkins-hbase9:43797] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:01:14,247 DEBUG [RS:2;jenkins-hbase9:44379] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-27 14:01:14,247 DEBUG [RS:0;jenkins-hbase9:43797] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-27 14:01:14,247 INFO [RS:2;jenkins-hbase9:44379] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-27 14:01:14,247 INFO [RS:0;jenkins-hbase9:43797] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-27 14:01:14,247 INFO [RS:2;jenkins-hbase9:44379] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-27 14:01:14,248 INFO [RS:0;jenkins-hbase9:43797] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-27 14:01:14,274 DEBUG [jenkins-hbase9:32789] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-09-27 14:01:14,278 DEBUG [jenkins-hbase9:32789] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-09-27 14:01:14,284 DEBUG [jenkins-hbase9:32789] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 14:01:14,284 DEBUG [jenkins-hbase9:32789] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 14:01:14,285 DEBUG [jenkins-hbase9:32789] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 14:01:14,285 DEBUG [jenkins-hbase9:32789] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 14:01:14,287 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,43797,1695823272608, state=OPENING 2023-09-27 14:01:14,295 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-09-27 14:01:14,297 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 14:01:14,297 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-27 14:01:14,301 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,43797,1695823272608}] 2023-09-27 14:01:14,355 INFO [RS:1;jenkins-hbase9:33659] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C33659%2C1695823272661, suffix=, logDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/WALs/jenkins-hbase9.apache.org,33659,1695823272661, archiveDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/oldWALs, maxLogs=32 2023-09-27 14:01:14,355 INFO [RS:2;jenkins-hbase9:44379] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C44379%2C1695823272702, suffix=, logDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/WALs/jenkins-hbase9.apache.org,44379,1695823272702, archiveDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/oldWALs, maxLogs=32 2023-09-27 14:01:14,355 INFO [RS:0;jenkins-hbase9:43797] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C43797%2C1695823272608, suffix=, logDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/WALs/jenkins-hbase9.apache.org,43797,1695823272608, archiveDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/oldWALs, maxLogs=32 2023-09-27 14:01:14,381 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38507,DS-e0545a9a-642b-4737-8fa9-b572d3223085,DISK] 2023-09-27 14:01:14,381 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39105,DS-e5f2c05b-d4d2-4296-a1f2-8e4a39b16940,DISK] 2023-09-27 14:01:14,381 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39105,DS-e5f2c05b-d4d2-4296-a1f2-8e4a39b16940,DISK] 2023-09-27 14:01:14,381 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38965,DS-b7e00073-3ef2-4eaa-81e6-acfd63230b71,DISK] 2023-09-27 14:01:14,381 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38507,DS-e0545a9a-642b-4737-8fa9-b572d3223085,DISK] 2023-09-27 14:01:14,381 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38965,DS-b7e00073-3ef2-4eaa-81e6-acfd63230b71,DISK] 2023-09-27 14:01:14,403 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39105,DS-e5f2c05b-d4d2-4296-a1f2-8e4a39b16940,DISK] 2023-09-27 14:01:14,403 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38507,DS-e0545a9a-642b-4737-8fa9-b572d3223085,DISK] 2023-09-27 14:01:14,404 INFO [RS:1;jenkins-hbase9:33659] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/WALs/jenkins-hbase9.apache.org,33659,1695823272661/jenkins-hbase9.apache.org%2C33659%2C1695823272661.1695823274358 2023-09-27 14:01:14,413 DEBUG [RS:1;jenkins-hbase9:33659] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39105,DS-e5f2c05b-d4d2-4296-a1f2-8e4a39b16940,DISK], DatanodeInfoWithStorage[127.0.0.1:38507,DS-e0545a9a-642b-4737-8fa9-b572d3223085,DISK], DatanodeInfoWithStorage[127.0.0.1:38965,DS-b7e00073-3ef2-4eaa-81e6-acfd63230b71,DISK]] 2023-09-27 14:01:14,415 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38965,DS-b7e00073-3ef2-4eaa-81e6-acfd63230b71,DISK] 2023-09-27 14:01:14,416 INFO [RS:2;jenkins-hbase9:44379] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/WALs/jenkins-hbase9.apache.org,44379,1695823272702/jenkins-hbase9.apache.org%2C44379%2C1695823272702.1695823274359 2023-09-27 14:01:14,417 DEBUG [RS:2;jenkins-hbase9:44379] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39105,DS-e5f2c05b-d4d2-4296-a1f2-8e4a39b16940,DISK], DatanodeInfoWithStorage[127.0.0.1:38965,DS-b7e00073-3ef2-4eaa-81e6-acfd63230b71,DISK], DatanodeInfoWithStorage[127.0.0.1:38507,DS-e0545a9a-642b-4737-8fa9-b572d3223085,DISK]] 2023-09-27 14:01:14,420 INFO [RS:0;jenkins-hbase9:43797] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/WALs/jenkins-hbase9.apache.org,43797,1695823272608/jenkins-hbase9.apache.org%2C43797%2C1695823272608.1695823274359 2023-09-27 14:01:14,422 DEBUG [RS:0;jenkins-hbase9:43797] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38507,DS-e0545a9a-642b-4737-8fa9-b572d3223085,DISK], DatanodeInfoWithStorage[127.0.0.1:38965,DS-b7e00073-3ef2-4eaa-81e6-acfd63230b71,DISK], DatanodeInfoWithStorage[127.0.0.1:39105,DS-e5f2c05b-d4d2-4296-a1f2-8e4a39b16940,DISK]] 2023-09-27 14:01:14,485 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:14,488 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-27 14:01:14,491 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:42844, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-27 14:01:14,504 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-09-27 14:01:14,504 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-27 14:01:14,508 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C43797%2C1695823272608.meta, suffix=.meta, logDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/WALs/jenkins-hbase9.apache.org,43797,1695823272608, archiveDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/oldWALs, maxLogs=32 2023-09-27 14:01:14,529 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38965,DS-b7e00073-3ef2-4eaa-81e6-acfd63230b71,DISK] 2023-09-27 14:01:14,530 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39105,DS-e5f2c05b-d4d2-4296-a1f2-8e4a39b16940,DISK] 2023-09-27 14:01:14,530 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38507,DS-e0545a9a-642b-4737-8fa9-b572d3223085,DISK] 2023-09-27 14:01:14,539 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/WALs/jenkins-hbase9.apache.org,43797,1695823272608/jenkins-hbase9.apache.org%2C43797%2C1695823272608.meta.1695823274509.meta 2023-09-27 14:01:14,541 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38965,DS-b7e00073-3ef2-4eaa-81e6-acfd63230b71,DISK], DatanodeInfoWithStorage[127.0.0.1:39105,DS-e5f2c05b-d4d2-4296-a1f2-8e4a39b16940,DISK], DatanodeInfoWithStorage[127.0.0.1:38507,DS-e0545a9a-642b-4737-8fa9-b572d3223085,DISK]] 2023-09-27 14:01:14,543 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-09-27 14:01:14,544 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-09-27 14:01:14,545 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 14:01:14,546 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-09-27 14:01:14,548 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-09-27 14:01:14,550 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-09-27 14:01:14,563 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-09-27 14:01:14,564 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 14:01:14,564 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-09-27 14:01:14,564 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-09-27 14:01:14,567 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-27 14:01:14,569 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/hbase/meta/1588230740/info 2023-09-27 14:01:14,569 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/hbase/meta/1588230740/info 2023-09-27 14:01:14,569 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-27 14:01:14,570 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 14:01:14,570 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-27 14:01:14,572 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/hbase/meta/1588230740/rep_barrier 2023-09-27 14:01:14,572 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/hbase/meta/1588230740/rep_barrier 2023-09-27 14:01:14,572 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-27 14:01:14,573 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 14:01:14,574 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-27 14:01:14,575 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/hbase/meta/1588230740/table 2023-09-27 14:01:14,575 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/hbase/meta/1588230740/table 2023-09-27 14:01:14,575 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-27 14:01:14,576 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 14:01:14,578 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/hbase/meta/1588230740 2023-09-27 14:01:14,581 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/hbase/meta/1588230740 2023-09-27 14:01:14,585 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-27 14:01:14,587 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-27 14:01:14,589 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64226385, jitterRate=-0.0429522842168808}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-27 14:01:14,592 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-27 14:01:14,601 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1695823274477 2023-09-27 14:01:14,620 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-09-27 14:01:14,621 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-09-27 14:01:14,621 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,43797,1695823272608, state=OPEN 2023-09-27 14:01:14,624 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-09-27 14:01:14,624 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-27 14:01:14,629 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-09-27 14:01:14,629 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,43797,1695823272608 in 323 msec 2023-09-27 14:01:14,634 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-09-27 14:01:14,634 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 538 msec 2023-09-27 14:01:14,641 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 791 msec 2023-09-27 14:01:14,641 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1695823274641, completionTime=-1 2023-09-27 14:01:14,641 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-09-27 14:01:14,642 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-09-27 14:01:14,719 DEBUG [hconnection-0x5ef90b03-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 14:01:14,722 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:42860, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 14:01:14,745 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-09-27 14:01:14,745 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1695823334745 2023-09-27 14:01:14,745 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1695823394745 2023-09-27 14:01:14,745 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 103 msec 2023-09-27 14:01:14,776 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,32789,1695823271327-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-27 14:01:14,776 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,32789,1695823271327-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-27 14:01:14,776 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,32789,1695823271327-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-27 14:01:14,779 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase9:32789, period=300000, unit=MILLISECONDS is enabled. 2023-09-27 14:01:14,780 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-09-27 14:01:14,788 DEBUG [master/jenkins-hbase9:0.Chore.1] janitor.CatalogJanitor(175): 2023-09-27 14:01:14,797 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-09-27 14:01:14,798 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-27 14:01:14,811 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-09-27 14:01:14,814 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-09-27 14:01:14,817 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-27 14:01:14,846 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/hbase/namespace/1f3d6c533eb0530f04a2c0dae249adc7 2023-09-27 14:01:14,849 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/hbase/namespace/1f3d6c533eb0530f04a2c0dae249adc7 empty. 2023-09-27 14:01:14,851 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/hbase/namespace/1f3d6c533eb0530f04a2c0dae249adc7 2023-09-27 14:01:14,851 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-09-27 14:01:14,889 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-09-27 14:01:14,891 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1f3d6c533eb0530f04a2c0dae249adc7, NAME => 'hbase:namespace,,1695823274797.1f3d6c533eb0530f04a2c0dae249adc7.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp 2023-09-27 14:01:14,914 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695823274797.1f3d6c533eb0530f04a2c0dae249adc7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 14:01:14,914 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 1f3d6c533eb0530f04a2c0dae249adc7, disabling compactions & flushes 2023-09-27 14:01:14,914 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695823274797.1f3d6c533eb0530f04a2c0dae249adc7. 2023-09-27 14:01:14,914 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695823274797.1f3d6c533eb0530f04a2c0dae249adc7. 2023-09-27 14:01:14,914 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695823274797.1f3d6c533eb0530f04a2c0dae249adc7. after waiting 0 ms 2023-09-27 14:01:14,914 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695823274797.1f3d6c533eb0530f04a2c0dae249adc7. 2023-09-27 14:01:14,914 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695823274797.1f3d6c533eb0530f04a2c0dae249adc7. 2023-09-27 14:01:14,914 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 1f3d6c533eb0530f04a2c0dae249adc7: 2023-09-27 14:01:14,919 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-09-27 14:01:14,935 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1695823274797.1f3d6c533eb0530f04a2c0dae249adc7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695823274923"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695823274923"}]},"ts":"1695823274923"} 2023-09-27 14:01:14,964 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-27 14:01:14,965 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-27 14:01:14,970 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695823274966"}]},"ts":"1695823274966"} 2023-09-27 14:01:14,975 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-09-27 14:01:14,980 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-09-27 14:01:14,982 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 14:01:14,982 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 14:01:14,982 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 14:01:14,982 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 14:01:14,984 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=1f3d6c533eb0530f04a2c0dae249adc7, ASSIGN}] 2023-09-27 14:01:14,987 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=1f3d6c533eb0530f04a2c0dae249adc7, ASSIGN 2023-09-27 14:01:14,989 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=1f3d6c533eb0530f04a2c0dae249adc7, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,43797,1695823272608; forceNewPlan=false, retain=false 2023-09-27 14:01:15,141 INFO [jenkins-hbase9:32789] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-27 14:01:15,142 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=1f3d6c533eb0530f04a2c0dae249adc7, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:15,143 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1695823274797.1f3d6c533eb0530f04a2c0dae249adc7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695823275142"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695823275142"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695823275142"}]},"ts":"1695823275142"} 2023-09-27 14:01:15,149 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 1f3d6c533eb0530f04a2c0dae249adc7, server=jenkins-hbase9.apache.org,43797,1695823272608}] 2023-09-27 14:01:15,311 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1695823274797.1f3d6c533eb0530f04a2c0dae249adc7. 2023-09-27 14:01:15,311 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1f3d6c533eb0530f04a2c0dae249adc7, NAME => 'hbase:namespace,,1695823274797.1f3d6c533eb0530f04a2c0dae249adc7.', STARTKEY => '', ENDKEY => ''} 2023-09-27 14:01:15,312 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1695823274797.1f3d6c533eb0530f04a2c0dae249adc7. service=AccessControlService 2023-09-27 14:01:15,313 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 14:01:15,313 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 1f3d6c533eb0530f04a2c0dae249adc7 2023-09-27 14:01:15,314 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695823274797.1f3d6c533eb0530f04a2c0dae249adc7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 14:01:15,314 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 1f3d6c533eb0530f04a2c0dae249adc7 2023-09-27 14:01:15,314 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 1f3d6c533eb0530f04a2c0dae249adc7 2023-09-27 14:01:15,317 INFO [StoreOpener-1f3d6c533eb0530f04a2c0dae249adc7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1f3d6c533eb0530f04a2c0dae249adc7 2023-09-27 14:01:15,319 DEBUG [StoreOpener-1f3d6c533eb0530f04a2c0dae249adc7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/hbase/namespace/1f3d6c533eb0530f04a2c0dae249adc7/info 2023-09-27 14:01:15,319 DEBUG [StoreOpener-1f3d6c533eb0530f04a2c0dae249adc7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/hbase/namespace/1f3d6c533eb0530f04a2c0dae249adc7/info 2023-09-27 14:01:15,320 INFO [StoreOpener-1f3d6c533eb0530f04a2c0dae249adc7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1f3d6c533eb0530f04a2c0dae249adc7 columnFamilyName info 2023-09-27 14:01:15,321 INFO [StoreOpener-1f3d6c533eb0530f04a2c0dae249adc7-1] regionserver.HStore(310): Store=1f3d6c533eb0530f04a2c0dae249adc7/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 14:01:15,323 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/hbase/namespace/1f3d6c533eb0530f04a2c0dae249adc7 2023-09-27 14:01:15,324 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/hbase/namespace/1f3d6c533eb0530f04a2c0dae249adc7 2023-09-27 14:01:15,329 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 1f3d6c533eb0530f04a2c0dae249adc7 2023-09-27 14:01:15,334 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/hbase/namespace/1f3d6c533eb0530f04a2c0dae249adc7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 14:01:15,335 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 1f3d6c533eb0530f04a2c0dae249adc7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65436659, jitterRate=-0.02491779625415802}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 14:01:15,335 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 1f3d6c533eb0530f04a2c0dae249adc7: 2023-09-27 14:01:15,339 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1695823274797.1f3d6c533eb0530f04a2c0dae249adc7., pid=6, masterSystemTime=1695823275303 2023-09-27 14:01:15,343 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1695823274797.1f3d6c533eb0530f04a2c0dae249adc7. 2023-09-27 14:01:15,343 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1695823274797.1f3d6c533eb0530f04a2c0dae249adc7. 2023-09-27 14:01:15,344 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=1f3d6c533eb0530f04a2c0dae249adc7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:15,345 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1695823274797.1f3d6c533eb0530f04a2c0dae249adc7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695823275344"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695823275344"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695823275344"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695823275344"}]},"ts":"1695823275344"} 2023-09-27 14:01:15,352 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-09-27 14:01:15,352 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 1f3d6c533eb0530f04a2c0dae249adc7, server=jenkins-hbase9.apache.org,43797,1695823272608 in 199 msec 2023-09-27 14:01:15,356 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-09-27 14:01:15,357 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=1f3d6c533eb0530f04a2c0dae249adc7, ASSIGN in 368 msec 2023-09-27 14:01:15,359 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-27 14:01:15,359 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695823275359"}]},"ts":"1695823275359"} 2023-09-27 14:01:15,361 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-09-27 14:01:15,366 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-09-27 14:01:15,370 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 568 msec 2023-09-27 14:01:15,417 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-09-27 14:01:15,419 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-09-27 14:01:15,419 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 14:01:15,455 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-09-27 14:01:15,473 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-27 14:01:15,479 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 31 msec 2023-09-27 14:01:15,489 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-09-27 14:01:15,505 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-27 14:01:15,512 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 22 msec 2023-09-27 14:01:15,526 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-09-27 14:01:15,532 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-09-27 14:01:15,532 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.759sec 2023-09-27 14:01:15,535 INFO [master/jenkins-hbase9:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-09-27 14:01:15,537 INFO [master/jenkins-hbase9:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-09-27 14:01:15,537 INFO [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-09-27 14:01:15,539 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,32789,1695823271327-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-09-27 14:01:15,539 DEBUG [Listener at localhost/37217] zookeeper.ReadOnlyZKClient(139): Connect 0x627146cd to 127.0.0.1:60071 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 14:01:15,539 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,32789,1695823271327-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-09-27 14:01:15,545 DEBUG [Listener at localhost/37217] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@cba4ac7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 14:01:15,565 DEBUG [hconnection-0x1eb93e1b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 14:01:15,568 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-27 14:01:15,571 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-09-27 14:01:15,573 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-09-27 14:01:15,575 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-27 14:01:15,578 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-09-27 14:01:15,578 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/hbase/acl/f648bd30610fcb063acfee82168ad9c8 2023-09-27 14:01:15,579 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/hbase/acl/f648bd30610fcb063acfee82168ad9c8 empty. 2023-09-27 14:01:15,582 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/hbase/acl/f648bd30610fcb063acfee82168ad9c8 2023-09-27 14:01:15,582 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-09-27 14:01:15,584 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:42864, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 14:01:15,587 INFO [Listener at localhost/37217] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase9.apache.org,32789,1695823271327 2023-09-27 14:01:15,587 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-27 14:01:15,587 INFO [Listener at localhost/37217] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-09-27 14:01:15,587 INFO [Listener at localhost/37217] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/test.cache.data in system properties and HBase conf 2023-09-27 14:01:15,587 INFO [Listener at localhost/37217] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/hadoop.tmp.dir in system properties and HBase conf 2023-09-27 14:01:15,588 INFO [Listener at localhost/37217] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/hadoop.log.dir in system properties and HBase conf 2023-09-27 14:01:15,588 INFO [Listener at localhost/37217] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-27 14:01:15,588 INFO [Listener at localhost/37217] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-27 14:01:15,588 INFO [Listener at localhost/37217] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-27 14:01:15,588 INFO [Listener at localhost/37217] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-27 14:01:15,588 INFO [Listener at localhost/37217] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-27 14:01:15,589 INFO [Listener at localhost/37217] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-27 14:01:15,589 INFO [Listener at localhost/37217] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-27 14:01:15,590 INFO [Listener at localhost/37217] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-27 14:01:15,590 INFO [Listener at localhost/37217] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-27 14:01:15,590 INFO [Listener at localhost/37217] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-27 14:01:15,590 INFO [Listener at localhost/37217] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-27 14:01:15,590 INFO [Listener at localhost/37217] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-27 14:01:15,590 INFO [Listener at localhost/37217] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/nfs.dump.dir in system properties and HBase conf 2023-09-27 14:01:15,590 INFO [Listener at localhost/37217] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/java.io.tmpdir in system properties and HBase conf 2023-09-27 14:01:15,591 INFO [Listener at localhost/37217] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-27 14:01:15,591 INFO [Listener at localhost/37217] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-27 14:01:15,591 INFO [Listener at localhost/37217] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-09-27 14:01:15,611 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-09-27 14:01:15,613 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => f648bd30610fcb063acfee82168ad9c8, NAME => 'hbase:acl,,1695823275561.f648bd30610fcb063acfee82168ad9c8.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp 2023-09-27 14:01:15,635 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695823275561.f648bd30610fcb063acfee82168ad9c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 14:01:15,636 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing f648bd30610fcb063acfee82168ad9c8, disabling compactions & flushes 2023-09-27 14:01:15,636 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695823275561.f648bd30610fcb063acfee82168ad9c8. 2023-09-27 14:01:15,636 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695823275561.f648bd30610fcb063acfee82168ad9c8. 2023-09-27 14:01:15,636 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695823275561.f648bd30610fcb063acfee82168ad9c8. after waiting 0 ms 2023-09-27 14:01:15,636 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695823275561.f648bd30610fcb063acfee82168ad9c8. 2023-09-27 14:01:15,636 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1695823275561.f648bd30610fcb063acfee82168ad9c8. 2023-09-27 14:01:15,636 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for f648bd30610fcb063acfee82168ad9c8: 2023-09-27 14:01:15,642 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-09-27 14:01:15,644 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1695823275561.f648bd30610fcb063acfee82168ad9c8.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695823275644"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695823275644"}]},"ts":"1695823275644"} 2023-09-27 14:01:15,647 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-27 14:01:15,649 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-27 14:01:15,650 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695823275649"}]},"ts":"1695823275649"} 2023-09-27 14:01:15,652 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-09-27 14:01:15,660 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-09-27 14:01:15,664 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 14:01:15,664 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 14:01:15,664 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 14:01:15,664 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 14:01:15,665 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=f648bd30610fcb063acfee82168ad9c8, ASSIGN}] 2023-09-27 14:01:15,668 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=f648bd30610fcb063acfee82168ad9c8, ASSIGN 2023-09-27 14:01:15,670 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=f648bd30610fcb063acfee82168ad9c8, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,44379,1695823272702; forceNewPlan=false, retain=false 2023-09-27 14:01:15,692 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-27 14:01:15,820 INFO [jenkins-hbase9:32789] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-27 14:01:15,821 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=f648bd30610fcb063acfee82168ad9c8, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:15,822 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1695823275561.f648bd30610fcb063acfee82168ad9c8.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695823275821"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695823275821"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695823275821"}]},"ts":"1695823275821"} 2023-09-27 14:01:15,825 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure f648bd30610fcb063acfee82168ad9c8, server=jenkins-hbase9.apache.org,44379,1695823272702}] 2023-09-27 14:01:15,892 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-27 14:01:15,980 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:15,980 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-27 14:01:15,984 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39092, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-27 14:01:15,991 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1695823275561.f648bd30610fcb063acfee82168ad9c8. 2023-09-27 14:01:15,991 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f648bd30610fcb063acfee82168ad9c8, NAME => 'hbase:acl,,1695823275561.f648bd30610fcb063acfee82168ad9c8.', STARTKEY => '', ENDKEY => ''} 2023-09-27 14:01:15,992 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1695823275561.f648bd30610fcb063acfee82168ad9c8. service=AccessControlService 2023-09-27 14:01:15,992 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 14:01:15,992 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl f648bd30610fcb063acfee82168ad9c8 2023-09-27 14:01:15,992 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695823275561.f648bd30610fcb063acfee82168ad9c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 14:01:15,992 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for f648bd30610fcb063acfee82168ad9c8 2023-09-27 14:01:15,993 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for f648bd30610fcb063acfee82168ad9c8 2023-09-27 14:01:15,995 INFO [StoreOpener-f648bd30610fcb063acfee82168ad9c8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region f648bd30610fcb063acfee82168ad9c8 2023-09-27 14:01:15,997 DEBUG [StoreOpener-f648bd30610fcb063acfee82168ad9c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/hbase/acl/f648bd30610fcb063acfee82168ad9c8/l 2023-09-27 14:01:15,997 DEBUG [StoreOpener-f648bd30610fcb063acfee82168ad9c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/hbase/acl/f648bd30610fcb063acfee82168ad9c8/l 2023-09-27 14:01:15,998 INFO [StoreOpener-f648bd30610fcb063acfee82168ad9c8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f648bd30610fcb063acfee82168ad9c8 columnFamilyName l 2023-09-27 14:01:15,999 INFO [StoreOpener-f648bd30610fcb063acfee82168ad9c8-1] regionserver.HStore(310): Store=f648bd30610fcb063acfee82168ad9c8/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 14:01:16,002 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/hbase/acl/f648bd30610fcb063acfee82168ad9c8 2023-09-27 14:01:16,003 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/hbase/acl/f648bd30610fcb063acfee82168ad9c8 2023-09-27 14:01:16,009 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for f648bd30610fcb063acfee82168ad9c8 2023-09-27 14:01:16,014 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/hbase/acl/f648bd30610fcb063acfee82168ad9c8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 14:01:16,015 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened f648bd30610fcb063acfee82168ad9c8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60799460, jitterRate=-0.09401744604110718}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 14:01:16,016 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for f648bd30610fcb063acfee82168ad9c8: 2023-09-27 14:01:16,020 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1695823275561.f648bd30610fcb063acfee82168ad9c8., pid=11, masterSystemTime=1695823275980 2023-09-27 14:01:16,024 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1695823275561.f648bd30610fcb063acfee82168ad9c8. 2023-09-27 14:01:16,025 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1695823275561.f648bd30610fcb063acfee82168ad9c8. 2023-09-27 14:01:16,027 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=f648bd30610fcb063acfee82168ad9c8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:16,027 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1695823275561.f648bd30610fcb063acfee82168ad9c8.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695823276026"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695823276026"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695823276026"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695823276026"}]},"ts":"1695823276026"} 2023-09-27 14:01:16,044 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-09-27 14:01:16,044 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure f648bd30610fcb063acfee82168ad9c8, server=jenkins-hbase9.apache.org,44379,1695823272702 in 205 msec 2023-09-27 14:01:16,049 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-09-27 14:01:16,050 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=f648bd30610fcb063acfee82168ad9c8, ASSIGN in 380 msec 2023-09-27 14:01:16,051 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-27 14:01:16,051 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695823276051"}]},"ts":"1695823276051"} 2023-09-27 14:01:16,053 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-09-27 14:01:16,057 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-09-27 14:01:16,060 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 489 msec 2023-09-27 14:01:16,192 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-27 14:01:16,193 INFO [master/jenkins-hbase9:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-09-27 14:01:16,204 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-09-27 14:01:16,839 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-27 14:01:17,190 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-09-27 14:01:17,199 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_38099_jobhistory____.bbucc1/webapp 2023-09-27 14:01:17,389 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-09-27 14:01:17,389 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-09-27 14:01:17,389 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-27 14:01:17,392 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-27 14:01:17,478 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 14:01:17,806 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 14:01:18,110 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-09-27 14:01:18,144 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:38099 2023-09-27 14:01:18,334 WARN [Listener at jenkins-hbase9.apache.org/44535] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-27 14:01:18,611 WARN [Listener at jenkins-hbase9.apache.org/44535] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-27 14:01:18,612 INFO [Listener at jenkins-hbase9.apache.org/44535] log.Slf4jLog(67): jetty-6.1.26 2023-09-27 14:01:18,620 INFO [Listener at jenkins-hbase9.apache.org/44535] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_43063_cluster____57ncyj/webapp 2023-09-27 14:01:18,691 INFO [Listener at jenkins-hbase9.apache.org/44535] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-09-27 14:01:18,691 INFO [Listener at jenkins-hbase9.apache.org/44535] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-09-27 14:01:18,691 INFO [Listener at jenkins-hbase9.apache.org/44535] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-27 14:01:18,692 INFO [Listener at jenkins-hbase9.apache.org/44535] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-27 14:01:18,702 INFO [Listener at jenkins-hbase9.apache.org/44535] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 14:01:18,923 INFO [Listener at jenkins-hbase9.apache.org/44535] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 14:01:19,053 INFO [Listener at jenkins-hbase9.apache.org/44535] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 14:01:19,066 INFO [Listener at jenkins-hbase9.apache.org/44535] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:43063 2023-09-27 14:01:19,518 WARN [Listener at jenkins-hbase9.apache.org/40359] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-27 14:01:19,542 WARN [Listener at jenkins-hbase9.apache.org/40359] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-27 14:01:19,543 INFO [Listener at jenkins-hbase9.apache.org/40359] log.Slf4jLog(67): jetty-6.1.26 2023-09-27 14:01:19,549 INFO [Listener at jenkins-hbase9.apache.org/40359] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_46359_node____.s37102/webapp 2023-09-27 14:01:19,629 INFO [Listener at jenkins-hbase9.apache.org/40359] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-27 14:01:19,629 INFO [Listener at jenkins-hbase9.apache.org/40359] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-27 14:01:19,629 INFO [Listener at jenkins-hbase9.apache.org/40359] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-27 14:01:19,629 INFO [Listener at jenkins-hbase9.apache.org/40359] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-27 14:01:19,638 INFO [Listener at jenkins-hbase9.apache.org/40359] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 14:01:19,660 INFO [Listener at jenkins-hbase9.apache.org/40359] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 14:01:19,752 INFO [Listener at jenkins-hbase9.apache.org/40359] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 14:01:19,769 INFO [Listener at jenkins-hbase9.apache.org/40359] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:46359 2023-09-27 14:01:19,961 WARN [Listener at jenkins-hbase9.apache.org/33737] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-27 14:01:19,966 WARN [Listener at jenkins-hbase9.apache.org/33737] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-27 14:01:19,967 INFO [Listener at jenkins-hbase9.apache.org/33737] log.Slf4jLog(67): jetty-6.1.26 2023-09-27 14:01:19,976 INFO [Listener at jenkins-hbase9.apache.org/33737] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_45255_node____.mzyu46/webapp 2023-09-27 14:01:20,041 INFO [Listener at jenkins-hbase9.apache.org/33737] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-27 14:01:20,042 INFO [Listener at jenkins-hbase9.apache.org/33737] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-27 14:01:20,042 INFO [Listener at jenkins-hbase9.apache.org/33737] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-27 14:01:20,042 INFO [Listener at jenkins-hbase9.apache.org/33737] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-27 14:01:20,050 INFO [Listener at jenkins-hbase9.apache.org/33737] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 14:01:20,063 INFO [Listener at jenkins-hbase9.apache.org/33737] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 14:01:20,112 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-27 14:01:20,158 INFO [Listener at jenkins-hbase9.apache.org/33737] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 14:01:20,177 INFO [Listener at jenkins-hbase9.apache.org/33737] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:45255 2023-09-27 14:01:20,223 INFO [Listener at jenkins-hbase9.apache.org/33737] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-09-27 14:01:20,225 INFO [Listener at jenkins-hbase9.apache.org/33737] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 14:01:20,311 INFO [Listener at jenkins-hbase9.apache.org/33737] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=707, OpenFileDescriptor=895, MaxFileDescriptor=60000, SystemLoadAverage=209, ProcessCount=165, AvailableMemoryMB=9776 2023-09-27 14:01:20,311 WARN [Listener at jenkins-hbase9.apache.org/33737] hbase.ResourceChecker(130): Thread=707 is superior to 500 2023-09-27 14:01:20,329 DEBUG [Listener at jenkins-hbase9.apache.org/33737] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-09-27 14:01:20,342 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:55370, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-09-27 14:01:20,354 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-27 14:01:20,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-09-27 14:01:20,360 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-09-27 14:01:20,361 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-09-27 14:01:20,362 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-09-27 14:01:20,363 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-27 14:01:20,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-27 14:01:20,364 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-09-27 14:01:20,366 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-09-27 14:01:20,368 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportWithTargetName/61c37603622d4550657305878a3d0d1c 2023-09-27 14:01:20,370 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportWithTargetName/61c37603622d4550657305878a3d0d1c empty. 2023-09-27 14:01:20,370 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportWithTargetName/4572df50f977945085c6a49848a8d6b3 2023-09-27 14:01:20,371 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportWithTargetName/61c37603622d4550657305878a3d0d1c 2023-09-27 14:01:20,372 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportWithTargetName/4572df50f977945085c6a49848a8d6b3 empty. 2023-09-27 14:01:20,374 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportWithTargetName/4572df50f977945085c6a49848a8d6b3 2023-09-27 14:01:20,374 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-27 14:01:20,403 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-09-27 14:01:20,404 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 61c37603622d4550657305878a3d0d1c, NAME => 'testtb-testExportWithTargetName,,1695823280353.61c37603622d4550657305878a3d0d1c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp 2023-09-27 14:01:20,404 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 4572df50f977945085c6a49848a8d6b3, NAME => 'testtb-testExportWithTargetName,1,1695823280353.4572df50f977945085c6a49848a8d6b3.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp 2023-09-27 14:01:20,447 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695823280353.4572df50f977945085c6a49848a8d6b3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 14:01:20,448 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 4572df50f977945085c6a49848a8d6b3, disabling compactions & flushes 2023-09-27 14:01:20,448 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695823280353.61c37603622d4550657305878a3d0d1c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 14:01:20,448 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695823280353.4572df50f977945085c6a49848a8d6b3. 2023-09-27 14:01:20,448 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 61c37603622d4550657305878a3d0d1c, disabling compactions & flushes 2023-09-27 14:01:20,449 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695823280353.4572df50f977945085c6a49848a8d6b3. 2023-09-27 14:01:20,449 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695823280353.61c37603622d4550657305878a3d0d1c. 2023-09-27 14:01:20,449 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695823280353.4572df50f977945085c6a49848a8d6b3. after waiting 0 ms 2023-09-27 14:01:20,449 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695823280353.61c37603622d4550657305878a3d0d1c. 2023-09-27 14:01:20,449 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695823280353.4572df50f977945085c6a49848a8d6b3. 2023-09-27 14:01:20,449 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695823280353.61c37603622d4550657305878a3d0d1c. after waiting 0 ms 2023-09-27 14:01:20,449 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695823280353.4572df50f977945085c6a49848a8d6b3. 2023-09-27 14:01:20,449 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695823280353.61c37603622d4550657305878a3d0d1c. 2023-09-27 14:01:20,449 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 4572df50f977945085c6a49848a8d6b3: 2023-09-27 14:01:20,449 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695823280353.61c37603622d4550657305878a3d0d1c. 2023-09-27 14:01:20,449 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 61c37603622d4550657305878a3d0d1c: 2023-09-27 14:01:20,454 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-09-27 14:01:20,456 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695823280353.4572df50f977945085c6a49848a8d6b3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695823280456"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695823280456"}]},"ts":"1695823280456"} 2023-09-27 14:01:20,456 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695823280353.61c37603622d4550657305878a3d0d1c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695823280456"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695823280456"}]},"ts":"1695823280456"} 2023-09-27 14:01:20,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-27 14:01:20,509 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-27 14:01:20,510 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-27 14:01:20,511 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695823280510"}]},"ts":"1695823280510"} 2023-09-27 14:01:20,513 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-09-27 14:01:20,518 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-09-27 14:01:20,521 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 14:01:20,522 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 14:01:20,522 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 14:01:20,522 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 14:01:20,522 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=61c37603622d4550657305878a3d0d1c, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4572df50f977945085c6a49848a8d6b3, ASSIGN}] 2023-09-27 14:01:20,525 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4572df50f977945085c6a49848a8d6b3, ASSIGN 2023-09-27 14:01:20,526 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=61c37603622d4550657305878a3d0d1c, ASSIGN 2023-09-27 14:01:20,527 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4572df50f977945085c6a49848a8d6b3, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,43797,1695823272608; forceNewPlan=false, retain=false 2023-09-27 14:01:20,527 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=61c37603622d4550657305878a3d0d1c, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,44379,1695823272702; forceNewPlan=false, retain=false 2023-09-27 14:01:20,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-27 14:01:20,678 INFO [jenkins-hbase9:32789] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-27 14:01:20,680 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=61c37603622d4550657305878a3d0d1c, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:20,680 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=4572df50f977945085c6a49848a8d6b3, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:20,680 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695823280353.61c37603622d4550657305878a3d0d1c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695823280680"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695823280680"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695823280680"}]},"ts":"1695823280680"} 2023-09-27 14:01:20,680 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695823280353.4572df50f977945085c6a49848a8d6b3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695823280680"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695823280680"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695823280680"}]},"ts":"1695823280680"} 2023-09-27 14:01:20,683 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 61c37603622d4550657305878a3d0d1c, server=jenkins-hbase9.apache.org,44379,1695823272702}] 2023-09-27 14:01:20,685 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure 4572df50f977945085c6a49848a8d6b3, server=jenkins-hbase9.apache.org,43797,1695823272608}] 2023-09-27 14:01:20,847 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1695823280353.61c37603622d4550657305878a3d0d1c. 2023-09-27 14:01:20,847 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1695823280353.4572df50f977945085c6a49848a8d6b3. 2023-09-27 14:01:20,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 61c37603622d4550657305878a3d0d1c, NAME => 'testtb-testExportWithTargetName,,1695823280353.61c37603622d4550657305878a3d0d1c.', STARTKEY => '', ENDKEY => '1'} 2023-09-27 14:01:20,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4572df50f977945085c6a49848a8d6b3, NAME => 'testtb-testExportWithTargetName,1,1695823280353.4572df50f977945085c6a49848a8d6b3.', STARTKEY => '1', ENDKEY => ''} 2023-09-27 14:01:20,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1695823280353.61c37603622d4550657305878a3d0d1c. service=AccessControlService 2023-09-27 14:01:20,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1695823280353.4572df50f977945085c6a49848a8d6b3. service=AccessControlService 2023-09-27 14:01:20,848 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 14:01:20,848 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 14:01:20,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 61c37603622d4550657305878a3d0d1c 2023-09-27 14:01:20,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 4572df50f977945085c6a49848a8d6b3 2023-09-27 14:01:20,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695823280353.61c37603622d4550657305878a3d0d1c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 14:01:20,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695823280353.4572df50f977945085c6a49848a8d6b3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 14:01:20,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 61c37603622d4550657305878a3d0d1c 2023-09-27 14:01:20,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 4572df50f977945085c6a49848a8d6b3 2023-09-27 14:01:20,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 61c37603622d4550657305878a3d0d1c 2023-09-27 14:01:20,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 4572df50f977945085c6a49848a8d6b3 2023-09-27 14:01:20,853 INFO [StoreOpener-61c37603622d4550657305878a3d0d1c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 61c37603622d4550657305878a3d0d1c 2023-09-27 14:01:20,853 INFO [StoreOpener-4572df50f977945085c6a49848a8d6b3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4572df50f977945085c6a49848a8d6b3 2023-09-27 14:01:20,861 DEBUG [StoreOpener-61c37603622d4550657305878a3d0d1c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportWithTargetName/61c37603622d4550657305878a3d0d1c/cf 2023-09-27 14:01:20,861 DEBUG [StoreOpener-4572df50f977945085c6a49848a8d6b3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportWithTargetName/4572df50f977945085c6a49848a8d6b3/cf 2023-09-27 14:01:20,862 DEBUG [StoreOpener-4572df50f977945085c6a49848a8d6b3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportWithTargetName/4572df50f977945085c6a49848a8d6b3/cf 2023-09-27 14:01:20,861 DEBUG [StoreOpener-61c37603622d4550657305878a3d0d1c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportWithTargetName/61c37603622d4550657305878a3d0d1c/cf 2023-09-27 14:01:20,865 INFO [StoreOpener-4572df50f977945085c6a49848a8d6b3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4572df50f977945085c6a49848a8d6b3 columnFamilyName cf 2023-09-27 14:01:20,865 INFO [StoreOpener-61c37603622d4550657305878a3d0d1c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 61c37603622d4550657305878a3d0d1c columnFamilyName cf 2023-09-27 14:01:20,868 INFO [StoreOpener-61c37603622d4550657305878a3d0d1c-1] regionserver.HStore(310): Store=61c37603622d4550657305878a3d0d1c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 14:01:20,868 INFO [StoreOpener-4572df50f977945085c6a49848a8d6b3-1] regionserver.HStore(310): Store=4572df50f977945085c6a49848a8d6b3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 14:01:20,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportWithTargetName/61c37603622d4550657305878a3d0d1c 2023-09-27 14:01:20,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportWithTargetName/4572df50f977945085c6a49848a8d6b3 2023-09-27 14:01:20,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportWithTargetName/61c37603622d4550657305878a3d0d1c 2023-09-27 14:01:20,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportWithTargetName/4572df50f977945085c6a49848a8d6b3 2023-09-27 14:01:20,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 61c37603622d4550657305878a3d0d1c 2023-09-27 14:01:20,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 4572df50f977945085c6a49848a8d6b3 2023-09-27 14:01:20,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportWithTargetName/61c37603622d4550657305878a3d0d1c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 14:01:20,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportWithTargetName/4572df50f977945085c6a49848a8d6b3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 14:01:20,890 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 61c37603622d4550657305878a3d0d1c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74729161, jitterRate=0.11355127394199371}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 14:01:20,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 61c37603622d4550657305878a3d0d1c: 2023-09-27 14:01:20,890 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 4572df50f977945085c6a49848a8d6b3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68245925, jitterRate=0.01694352924823761}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 14:01:20,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 4572df50f977945085c6a49848a8d6b3: 2023-09-27 14:01:20,891 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1695823280353.61c37603622d4550657305878a3d0d1c., pid=15, masterSystemTime=1695823280836 2023-09-27 14:01:20,892 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1695823280353.4572df50f977945085c6a49848a8d6b3., pid=16, masterSystemTime=1695823280837 2023-09-27 14:01:20,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1695823280353.61c37603622d4550657305878a3d0d1c. 2023-09-27 14:01:20,894 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1695823280353.61c37603622d4550657305878a3d0d1c. 2023-09-27 14:01:20,895 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=61c37603622d4550657305878a3d0d1c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:20,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1695823280353.4572df50f977945085c6a49848a8d6b3. 2023-09-27 14:01:20,895 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1695823280353.4572df50f977945085c6a49848a8d6b3. 2023-09-27 14:01:20,895 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1695823280353.61c37603622d4550657305878a3d0d1c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695823280895"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695823280895"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695823280895"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695823280895"}]},"ts":"1695823280895"} 2023-09-27 14:01:20,896 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=4572df50f977945085c6a49848a8d6b3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:20,896 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1695823280353.4572df50f977945085c6a49848a8d6b3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695823280896"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695823280896"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695823280896"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695823280896"}]},"ts":"1695823280896"} 2023-09-27 14:01:20,901 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=13 2023-09-27 14:01:20,902 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 61c37603622d4550657305878a3d0d1c, server=jenkins-hbase9.apache.org,44379,1695823272702 in 215 msec 2023-09-27 14:01:20,904 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=14 2023-09-27 14:01:20,905 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure 4572df50f977945085c6a49848a8d6b3, server=jenkins-hbase9.apache.org,43797,1695823272608 in 215 msec 2023-09-27 14:01:20,905 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=61c37603622d4550657305878a3d0d1c, ASSIGN in 380 msec 2023-09-27 14:01:20,909 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=12 2023-09-27 14:01:20,909 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4572df50f977945085c6a49848a8d6b3, ASSIGN in 383 msec 2023-09-27 14:01:20,910 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-27 14:01:20,910 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695823280910"}]},"ts":"1695823280910"} 2023-09-27 14:01:20,912 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-09-27 14:01:20,915 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-09-27 14:01:20,921 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-09-27 14:01:20,927 DEBUG [PEWorker-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 14:01:20,928 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43430, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 14:01:20,932 DEBUG [hconnection-0x73e2f207-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 14:01:20,935 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:59184, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=ClientService 2023-09-27 14:01:20,943 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44379] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-27 14:01:20,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-27 14:01:20,974 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-27 14:01:20,974 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-27 14:01:20,974 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-27 14:01:20,974 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-27 14:01:20,974 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 14:01:20,981 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-27 14:01:20,981 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-27 14:01:20,981 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-27 14:01:20,981 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-27 14:01:20,985 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 628 msec 2023-09-27 14:01:21,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-27 14:01:21,473 INFO [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-09-27 14:01:21,478 DEBUG [Listener at jenkins-hbase9.apache.org/33737] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-27 14:01:21,479 DEBUG [Listener at jenkins-hbase9.apache.org/33737] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695823280353.61c37603622d4550657305878a3d0d1c. 2023-09-27 14:01:21,482 INFO [Listener at jenkins-hbase9.apache.org/33737] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 14:01:21,510 DEBUG [hconnection-0x1eb93e1b-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 14:01:21,514 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 14:01:21,515 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-09-27 14:01:21,515 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43442, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 14:01:21,515 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 14:01:21,515 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-09-27 14:01:21,516 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-27 14:01:21,516 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-09-27 14:01:21,516 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 14:01:21,516 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-09-27 14:01:21,516 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-27 14:01:21,516 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-09-27 14:01:21,535 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-27 14:01:21,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695823281535 (current time:1695823281535). 2023-09-27 14:01:21,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 14:01:21,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(139): Connect 0x5c8c25c7 to 127.0.0.1:60071 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 14:01:21,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b82dc6d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 14:01:21,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 14:01:21,548 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:59196, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 14:01:21,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5c8c25c7 to 127.0.0.1:60071 2023-09-27 14:01:21,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 14:01:21,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(139): Connect 0x41512e40 to 127.0.0.1:60071 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 14:01:21,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2c5ee0f0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 14:01:21,562 DEBUG [hconnection-0x2f806bc8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 14:01:21,563 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:59198, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 14:01:21,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 14:01:21,569 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43452, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 14:01:21,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x41512e40 to 127.0.0.1:60071 2023-09-27 14:01:21,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 14:01:21,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-27 14:01:21,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 14:01:21,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-27 14:01:21,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-27 14:01:21,622 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-27 14:01:21,624 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695823881623 2023-09-27 14:01:21,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-27 14:01:21,624 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-27 14:01:21,627 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-27 14:01:21,629 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-27 14:01:21,630 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 14 msec 2023-09-27 14:01:21,631 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-27 14:01:21,632 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695823881632 2023-09-27 14:01:21,633 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 14:01:21,633 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 14:01:21,660 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,660 INFO [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-09-27 14:01:21,661 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:01:21,661 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-09-27 14:01:21,662 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-27 14:01:21,662 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,663 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,668 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:01:21,668 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:01:21,668 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:21,668 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:01:21,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:01:21,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:01:21,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:01:21,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:01:21,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:01:21,669 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:21,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:01:21,669 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:21,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,669 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:21,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,669 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 14:01:21,670 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,670 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,670 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-27 14:01:21,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-27 14:01:21,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-27 14:01:21,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,672 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-27 14:01:21,672 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-27 14:01:21,672 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-27 14:01:21,674 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,675 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,674 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,678 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-27 14:01:21,678 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-27 14:01:21,678 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-27 14:01:21,678 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:01:21,678 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:01:21,679 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-27 14:01:21,678 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:01:21,680 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-27 14:01:21,680 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-27 14:01:21,681 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33659,1695823272661' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-27 14:01:21,681 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-27 14:01:21,681 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-27 14:01:21,681 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-27 14:01:21,681 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44379,1695823272702' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-27 14:01:21,681 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,43797,1695823272608' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-27 14:01:21,685 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,686 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:21,685 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:21,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:01:21,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:01:21,686 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:21,686 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:01:21,686 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,686 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 14:01:21,686 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,687 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 14:01:21,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:01:21,687 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,687 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 14:01:21,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:21,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:21,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:21,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:01:21,689 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44379,1695823272702' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-27 14:01:21,689 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@456c36c4[Count = 1] remaining members to acquire global barrier 2023-09-27 14:01:21,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:21,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:01:21,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:01:21,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:01:21,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:01:21,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:21,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:21,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:21,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:01:21,692 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,43797,1695823272608' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-27 14:01:21,692 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@456c36c4[Count = 0] remaining members to acquire global barrier 2023-09-27 14:01:21,692 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-27 14:01:21,692 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,695 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,695 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,695 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-27 14:01:21,695 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-27 14:01:21,695 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,695 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:21,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,695 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-27 14:01:21,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,695 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,33659,1695823272661' in zk 2023-09-27 14:01:21,695 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-27 14:01:21,696 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:21,696 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 14:01:21,696 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 14:01:21,696 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 14:01:21,696 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695823280353.4572df50f977945085c6a49848a8d6b3. 2023-09-27 14:01:21,696 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695823280353.61c37603622d4550657305878a3d0d1c. 2023-09-27 14:01:21,696 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 14:01:21,696 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 14:01:21,697 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695823280353.61c37603622d4550657305878a3d0d1c. started... 2023-09-27 14:01:21,697 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695823280353.4572df50f977945085c6a49848a8d6b3. started... 2023-09-27 14:01:21,700 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-27 14:01:21,700 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:01:21,700 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-27 14:01:21,702 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4572df50f977945085c6a49848a8d6b3: 2023-09-27 14:01:21,702 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 61c37603622d4550657305878a3d0d1c: 2023-09-27 14:01:21,703 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695823280353.4572df50f977945085c6a49848a8d6b3.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,703 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695823280353.61c37603622d4550657305878a3d0d1c.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,709 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 14:01:21,709 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 14:01:21,712 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 14:01:21,712 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 14:01:21,734 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 14:01:21,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-27 14:01:21,748 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695823280353.61c37603622d4550657305878a3d0d1c. completed. 2023-09-27 14:01:21,748 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695823280353.61c37603622d4550657305878a3d0d1c. 2023-09-27 14:01:21,748 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 14:01:21,748 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 14:01:21,748 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:21,748 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-27 14:01:21,748 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,44379,1695823272702' in zk 2023-09-27 14:01:21,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-27 14:01:21,750 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695823280353.4572df50f977945085c6a49848a8d6b3. completed. 2023-09-27 14:01:21,750 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695823280353.4572df50f977945085c6a49848a8d6b3. 2023-09-27 14:01:21,750 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 14:01:21,750 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 14:01:21,750 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 14:01:21,750 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:21,750 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-27 14:01:21,750 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,43797,1695823272608' in zk 2023-09-27 14:01:21,752 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:21,752 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-27 14:01:21,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:21,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:01:21,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:01:21,753 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:01:21,754 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-27 14:01:21,755 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-27 14:01:21,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:01:21,756 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:01:21,755 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:21,756 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-27 14:01:21,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:01:21,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:21,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:21,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:21,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:01:21,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:21,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:21,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:21,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,44379,1695823272702': 2023-09-27 14:01:21,762 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44379,1695823272702' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-27 14:01:21,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:21,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:01:21,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:01:21,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:01:21,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:01:21,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:21,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:21,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:21,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:01:21,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:21,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:21,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:21,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,43797,1695823272608': 2023-09-27 14:01:21,767 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,43797,1695823272608' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-27 14:01:21,767 INFO [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-09-27 14:01:21,767 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 14:01:21,767 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 14:01:21,767 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,767 INFO [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 14:01:21,770 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,770 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:01:21,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:01:21,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,770 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,770 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:01:21,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,770 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,770 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:01:21,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:01:21,771 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:21,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:01:21,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:01:21,770 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:01:21,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:01:21,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:01:21,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,771 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:21,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:01:21,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:01:21,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:01:21,772 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:21,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:21,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:21,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:21,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:01:21,774 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:21,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,775 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:21,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:21,775 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:21,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:21,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:21,789 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:01:21,789 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:01:21,789 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:01:21,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:01:21,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:01:21,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:01:21,789 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:01:21,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:01:21,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:01:21,789 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,789 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:01:21,790 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-27 14:01:21,789 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:21,789 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:01:21,790 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,790 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,790 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 14:01:21,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:01:21,789 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:01:21,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:01:21,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:01:21,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:01:21,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:01:21,790 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:21,790 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:21,790 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,790 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:21,790 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,791 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:21,791 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:21,791 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:01:21,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:01:21,791 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,792 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-27 14:01:21,811 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,815 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,869 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,870 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-27 14:01:21,870 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,871 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:21,871 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695823281624Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695823281811 (+187 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1695823281811Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1695823281812 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1695823281826 (+14 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1695823281854 (+28 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695823281870 (+16 ms) 2023-09-27 14:01:21,874 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-27 14:01:21,876 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 248 msec 2023-09-27 14:01:21,950 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 14:01:21,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-27 14:01:21,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 14:01:21,967 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44379] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1695823280353.61c37603622d4550657305878a3d0d1c. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 14:01:21,968 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43797] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1695823280353.4572df50f977945085c6a49848a8d6b3. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 14:01:21,974 DEBUG [Listener at jenkins-hbase9.apache.org/33737] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-27 14:01:21,974 DEBUG [Listener at jenkins-hbase9.apache.org/33737] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695823280353.61c37603622d4550657305878a3d0d1c. 2023-09-27 14:01:21,974 INFO [Listener at jenkins-hbase9.apache.org/33737] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 14:01:21,992 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-27 14:01:21,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695823281992 (current time:1695823281992). 2023-09-27 14:01:21,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 14:01:21,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(139): Connect 0x7c24fa8f to 127.0.0.1:60071 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 14:01:22,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@99342ad, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 14:01:22,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 14:01:22,006 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:59214, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 14:01:22,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7c24fa8f to 127.0.0.1:60071 2023-09-27 14:01:22,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 14:01:22,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(139): Connect 0x05ca26e3 to 127.0.0.1:60071 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 14:01:22,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ee14457, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 14:01:22,015 DEBUG [hconnection-0x4df4e30c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 14:01:22,018 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:59228, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 14:01:22,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 14:01:22,025 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43456, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 14:01:22,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x05ca26e3 to 127.0.0.1:60071 2023-09-27 14:01:22,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 14:01:22,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-27 14:01:22,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 14:01:22,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-27 14:01:22,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-27 14:01:22,033 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-27 14:01:22,034 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695823882034 2023-09-27 14:01:22,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-27 14:01:22,035 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-27 14:01:22,036 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 14:01:22,037 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 14:01:22,038 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-27 14:01:22,038 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-27 14:01:22,040 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 8 msec 2023-09-27 14:01:22,041 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-27 14:01:22,042 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695823882042 2023-09-27 14:01:22,058 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-09-27 14:01:22,058 INFO [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-09-27 14:01:22,058 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:01:22,059 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-09-27 14:01:22,059 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-27 14:01:22,060 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,060 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,064 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:01:22,064 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:01:22,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:01:22,064 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:22,064 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:01:22,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:01:22,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:01:22,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:01:22,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:01:22,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:01:22,065 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:22,065 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:22,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,065 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:22,065 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,065 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 14:01:22,066 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,066 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-27 14:01:22,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-27 14:01:22,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-27 14:01:22,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,066 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-27 14:01:22,066 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-27 14:01:22,066 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-27 14:01:22,067 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-27 14:01:22,067 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-27 14:01:22,067 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-27 14:01:22,067 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-27 14:01:22,067 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-27 14:01:22,067 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:01:22,067 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-27 14:01:22,068 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-27 14:01:22,068 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-27 14:01:22,068 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44379,1695823272702' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-27 14:01:22,067 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:01:22,068 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:01:22,069 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-27 14:01:22,070 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-27 14:01:22,070 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-27 14:01:22,070 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,43797,1695823272608' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-27 14:01:22,070 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-27 14:01:22,070 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33659,1695823272661' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-27 14:01:22,072 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:22,072 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:22,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:01:22,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:01:22,073 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:22,073 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,074 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,074 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:01:22,074 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,074 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 14:01:22,074 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 14:01:22,074 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,074 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 14:01:22,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:01:22,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-27 14:01:22,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:22,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:22,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:22,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:01:22,076 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44379,1695823272702' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-27 14:01:22,076 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e6bd00[Count = 1] remaining members to acquire global barrier 2023-09-27 14:01:22,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:22,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:01:22,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:01:22,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:01:22,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:01:22,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-27 14:01:22,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:22,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:22,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:22,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:01:22,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,43797,1695823272608' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-27 14:01:22,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e6bd00[Count = 0] remaining members to acquire global barrier 2023-09-27 14:01:22,079 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-27 14:01:22,079 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,083 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,083 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,083 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,084 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-27 14:01:22,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,084 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-27 14:01:22,084 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:22,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,084 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,33659,1695823272661' in zk 2023-09-27 14:01:22,084 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-27 14:01:22,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,084 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:22,084 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 14:01:22,084 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 14:01:22,084 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-27 14:01:22,084 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695823280353.4572df50f977945085c6a49848a8d6b3. 2023-09-27 14:01:22,084 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 14:01:22,085 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695823280353.4572df50f977945085c6a49848a8d6b3. started... 2023-09-27 14:01:22,085 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 14:01:22,085 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 14:01:22,085 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695823280353.61c37603622d4550657305878a3d0d1c. 2023-09-27 14:01:22,085 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695823280353.61c37603622d4550657305878a3d0d1c. started... 2023-09-27 14:01:22,085 INFO [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 61c37603622d4550657305878a3d0d1c 1/1 column families, dataSize=333 B heapSize=976 B 2023-09-27 14:01:22,085 INFO [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4572df50f977945085c6a49848a8d6b3 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-09-27 14:01:22,087 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-27 14:01:22,087 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:01:22,087 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-27 14:01:22,137 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 14:01:22,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-27 14:01:22,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-27 14:01:22,139 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 14:01:22,231 INFO [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230927b73438c4fdb242c9b6fe2251e582dbeb to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230927b73438c4fdb242c9b6fe2251e582dbeb 2023-09-27 14:01:22,231 INFO [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230927f89d13dd4d7d43ee86898e7b18d5ef0a to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230927f89d13dd4d7d43ee86898e7b18d5ef0a 2023-09-27 14:01:22,269 INFO [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportWithTargetName/61c37603622d4550657305878a3d0d1c/.tmp/cf/34eeaa9d7a3f42269661c5221adcc29d 2023-09-27 14:01:22,270 INFO [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportWithTargetName/4572df50f977945085c6a49848a8d6b3/.tmp/cf/b75261bcf9364391929de8f5384c8f6e 2023-09-27 14:01:22,283 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportWithTargetName/4572df50f977945085c6a49848a8d6b3/.tmp/cf/b75261bcf9364391929de8f5384c8f6e as hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportWithTargetName/4572df50f977945085c6a49848a8d6b3/cf/b75261bcf9364391929de8f5384c8f6e 2023-09-27 14:01:22,283 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportWithTargetName/61c37603622d4550657305878a3d0d1c/.tmp/cf/34eeaa9d7a3f42269661c5221adcc29d as hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportWithTargetName/61c37603622d4550657305878a3d0d1c/cf/34eeaa9d7a3f42269661c5221adcc29d 2023-09-27 14:01:22,295 INFO [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportWithTargetName/4572df50f977945085c6a49848a8d6b3/cf/b75261bcf9364391929de8f5384c8f6e, entries=45, sequenceid=6, filesize=12.5 K 2023-09-27 14:01:22,295 INFO [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportWithTargetName/61c37603622d4550657305878a3d0d1c/cf/34eeaa9d7a3f42269661c5221adcc29d, entries=5, sequenceid=6, filesize=5.7 K 2023-09-27 14:01:22,300 INFO [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 61c37603622d4550657305878a3d0d1c in 215ms, sequenceid=6, compaction requested=false 2023-09-27 14:01:22,300 INFO [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 4572df50f977945085c6a49848a8d6b3 in 215ms, sequenceid=6, compaction requested=false 2023-09-27 14:01:22,300 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-27 14:01:22,300 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-27 14:01:22,303 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4572df50f977945085c6a49848a8d6b3: 2023-09-27 14:01:22,303 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 61c37603622d4550657305878a3d0d1c: 2023-09-27 14:01:22,303 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695823280353.4572df50f977945085c6a49848a8d6b3.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-27 14:01:22,304 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 14:01:22,304 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695823280353.61c37603622d4550657305878a3d0d1c.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-27 14:01:22,304 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportWithTargetName/4572df50f977945085c6a49848a8d6b3/cf/b75261bcf9364391929de8f5384c8f6e] hfiles 2023-09-27 14:01:22,304 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 14:01:22,304 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportWithTargetName/4572df50f977945085c6a49848a8d6b3/cf/b75261bcf9364391929de8f5384c8f6e for snapshot=snaptb0-testExportWithTargetName 2023-09-27 14:01:22,304 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportWithTargetName/61c37603622d4550657305878a3d0d1c/cf/34eeaa9d7a3f42269661c5221adcc29d] hfiles 2023-09-27 14:01:22,304 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportWithTargetName/61c37603622d4550657305878a3d0d1c/cf/34eeaa9d7a3f42269661c5221adcc29d for snapshot=snaptb0-testExportWithTargetName 2023-09-27 14:01:22,332 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695823280353.4572df50f977945085c6a49848a8d6b3. completed. 2023-09-27 14:01:22,332 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695823280353.4572df50f977945085c6a49848a8d6b3. 2023-09-27 14:01:22,332 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 14:01:22,333 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 14:01:22,333 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:22,333 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-27 14:01:22,333 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,43797,1695823272608' in zk 2023-09-27 14:01:22,334 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695823280353.61c37603622d4550657305878a3d0d1c. completed. 2023-09-27 14:01:22,334 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695823280353.61c37603622d4550657305878a3d0d1c. 2023-09-27 14:01:22,334 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 14:01:22,334 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 14:01:22,334 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:22,334 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-27 14:01:22,334 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,44379,1695823272702' in zk 2023-09-27 14:01:22,334 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-27 14:01:22,334 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:22,334 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:01:22,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:22,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:01:22,335 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-27 14:01:22,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:01:22,337 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-27 14:01:22,337 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:22,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:01:22,337 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:01:22,338 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-27 14:01:22,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:01:22,339 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 14:01:22,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-27 14:01:22,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:22,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:22,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:22,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-27 14:01:22,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-27 14:01:22,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:01:22,341 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-27 14:01:22,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-27 14:01:22,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:22,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:22,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:22,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,43797,1695823272608': 2023-09-27 14:01:22,343 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,43797,1695823272608' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-27 14:01:22,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:22,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:01:22,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:01:22,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:01:22,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:01:22,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-27 14:01:22,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:22,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:22,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:22,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:01:22,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-27 14:01:22,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:22,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:22,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:22,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,44379,1695823272702': 2023-09-27 14:01:22,348 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44379,1695823272702' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-27 14:01:22,348 INFO [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-09-27 14:01:22,348 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 14:01:22,348 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 14:01:22,348 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-09-27 14:01:22,348 INFO [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 14:01:22,351 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,351 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,351 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:01:22,351 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:01:22,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,351 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:01:22,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:01:22,351 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,351 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:01:22,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:01:22,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:01:22,352 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:22,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:01:22,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:01:22,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:01:22,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:01:22,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:01:22,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,353 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:22,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-27 14:01:22,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,353 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:22,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:01:22,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-27 14:01:22,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:22,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:22,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:22,356 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:22,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:01:22,356 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:22,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-27 14:01:22,357 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:22,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:22,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:22,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:22,368 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:01:22,368 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:01:22,368 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:01:22,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:01:22,368 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:01:22,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:01:22,368 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:01:22,369 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:22,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:01:22,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:01:22,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:01:22,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:01:22,369 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,369 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:22,369 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:22,369 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,369 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:22,369 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,369 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:22,369 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:22,369 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,369 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,369 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:01:22,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:01:22,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:01:22,370 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-09-27 14:01:22,370 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-27 14:01:22,370 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:01:22,370 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-27 14:01:22,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:01:22,371 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 14:01:22,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:01:22,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:01:22,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:01:22,373 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230927b73438c4fdb242c9b6fe2251e582dbeb, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230927f89d13dd4d7d43ee86898e7b18d5ef0a] mob files 2023-09-27 14:01:22,373 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230927b73438c4fdb242c9b6fe2251e582dbeb 2023-09-27 14:01:22,373 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230927f89d13dd4d7d43ee86898e7b18d5ef0a 2023-09-27 14:01:22,388 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-09-27 14:01:22,389 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,428 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,429 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-27 14:01:22,429 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,430 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-27 14:01:22,430 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695823282035Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695823282388 (+353 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1695823282388Loading Region manifests for snaptb0-testExportWithTargetName at 1695823282388Writing data manifest for snaptb0-testExportWithTargetName at 1695823282394 (+6 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1695823282417 (+23 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695823282429 (+12 ms) 2023-09-27 14:01:22,432 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-27 14:01:22,435 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 397 msec 2023-09-27 14:01:22,641 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 14:01:22,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-27 14:01:22,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 14:01:22,645 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823282645 2023-09-27 14:01:22,645 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:46363, tgtDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823282645, rawTgtDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823282645, srcFsUri=hdfs://localhost:46363, srcDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30 2023-09-27 14:01:22,691 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:46363, inputRoot=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30 2023-09-27 14:01:22,691 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-262978908_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823282645, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823282645/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-27 14:01:22,691 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:46363, inputRoot=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30, snapshotDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-09-27 14:01:22,712 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823282645/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-27 14:01:23,176 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-27 14:01:23,176 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-27 14:01:23,177 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-27 14:01:23,177 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-27 14:01:24,085 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/hadoop-6848520127019194461.jar 2023-09-27 14:01:24,086 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-27 14:01:24,086 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-27 14:01:24,154 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/hadoop-8329816863627919588.jar 2023-09-27 14:01:24,155 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-27 14:01:24,156 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-27 14:01:24,156 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-27 14:01:24,157 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-27 14:01:24,157 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-27 14:01:24,158 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-27 14:01:24,158 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-27 14:01:24,159 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-27 14:01:24,160 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-27 14:01:24,160 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-27 14:01:24,161 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-27 14:01:24,161 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-27 14:01:24,162 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-27 14:01:24,162 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-27 14:01:24,162 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-27 14:01:24,163 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-27 14:01:24,167 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 14:01:24,168 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 14:01:24,168 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 14:01:24,168 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 14:01:24,169 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 14:01:24,169 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 14:01:24,170 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 14:01:25,396 WARN [Listener at jenkins-hbase9.apache.org/33737] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-27 14:01:25,402 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-09-27 14:01:25,411 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-27 14:01:25,903 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 14:01:25,905 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 14:01:26,354 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695823279135_0001_000001 (auth:SIMPLE) 2023-09-27 14:01:26,354 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-27 14:01:30,782 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695823279135_0001_000001 (auth:SIMPLE) 2023-09-27 14:01:33,044 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695823279135_0001_000001 (auth:SIMPLE) 2023-09-27 14:01:36,481 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695823279135_0001_000001 (auth:SIMPLE) 2023-09-27 14:01:38,338 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-27 14:01:38,343 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-27 14:01:38,356 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-09-27 14:01:38,356 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-27 14:01:38,357 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-27 14:01:38,357 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1724413351_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-27 14:01:38,358 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(367): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-09-27 14:01:38,358 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(367): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-09-27 14:01:38,358 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1724413351_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823282645/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823282645/.hbase-snapshot/testExportWithTargetName 2023-09-27 14:01:38,359 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(367): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823282645/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-09-27 14:01:38,359 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(367): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823282645/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-09-27 14:01:38,371 INFO [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-09-27 14:01:38,376 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportWithTargetName 2023-09-27 14:01:38,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-09-27 14:01:38,391 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695823298391"}]},"ts":"1695823298391"} 2023-09-27 14:01:38,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-27 14:01:38,393 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-09-27 14:01:38,426 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-09-27 14:01:38,428 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=61c37603622d4550657305878a3d0d1c, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4572df50f977945085c6a49848a8d6b3, UNASSIGN}] 2023-09-27 14:01:38,431 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=61c37603622d4550657305878a3d0d1c, UNASSIGN 2023-09-27 14:01:38,431 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4572df50f977945085c6a49848a8d6b3, UNASSIGN 2023-09-27 14:01:38,432 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=61c37603622d4550657305878a3d0d1c, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:38,432 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=4572df50f977945085c6a49848a8d6b3, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:38,432 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695823280353.61c37603622d4550657305878a3d0d1c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695823298432"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695823298432"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695823298432"}]},"ts":"1695823298432"} 2023-09-27 14:01:38,432 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695823280353.4572df50f977945085c6a49848a8d6b3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695823298432"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695823298432"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695823298432"}]},"ts":"1695823298432"} 2023-09-27 14:01:38,435 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 61c37603622d4550657305878a3d0d1c, server=jenkins-hbase9.apache.org,44379,1695823272702}] 2023-09-27 14:01:38,436 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 4572df50f977945085c6a49848a8d6b3, server=jenkins-hbase9.apache.org,43797,1695823272608}] 2023-09-27 14:01:38,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-27 14:01:38,597 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 61c37603622d4550657305878a3d0d1c 2023-09-27 14:01:38,597 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 4572df50f977945085c6a49848a8d6b3 2023-09-27 14:01:38,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 61c37603622d4550657305878a3d0d1c, disabling compactions & flushes 2023-09-27 14:01:38,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 4572df50f977945085c6a49848a8d6b3, disabling compactions & flushes 2023-09-27 14:01:38,597 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695823280353.61c37603622d4550657305878a3d0d1c. 2023-09-27 14:01:38,598 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695823280353.4572df50f977945085c6a49848a8d6b3. 2023-09-27 14:01:38,598 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695823280353.61c37603622d4550657305878a3d0d1c. 2023-09-27 14:01:38,598 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695823280353.4572df50f977945085c6a49848a8d6b3. 2023-09-27 14:01:38,598 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695823280353.61c37603622d4550657305878a3d0d1c. after waiting 0 ms 2023-09-27 14:01:38,598 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695823280353.61c37603622d4550657305878a3d0d1c. 2023-09-27 14:01:38,598 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695823280353.4572df50f977945085c6a49848a8d6b3. after waiting 0 ms 2023-09-27 14:01:38,598 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695823280353.4572df50f977945085c6a49848a8d6b3. 2023-09-27 14:01:38,616 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportWithTargetName/4572df50f977945085c6a49848a8d6b3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 14:01:38,616 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportWithTargetName/61c37603622d4550657305878a3d0d1c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 14:01:38,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 14:01:38,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 14:01:38,618 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695823280353.61c37603622d4550657305878a3d0d1c. 2023-09-27 14:01:38,618 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695823280353.4572df50f977945085c6a49848a8d6b3. 2023-09-27 14:01:38,619 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 61c37603622d4550657305878a3d0d1c: 2023-09-27 14:01:38,619 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 4572df50f977945085c6a49848a8d6b3: 2023-09-27 14:01:38,621 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 4572df50f977945085c6a49848a8d6b3 2023-09-27 14:01:38,622 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=4572df50f977945085c6a49848a8d6b3, regionState=CLOSED 2023-09-27 14:01:38,623 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695823280353.4572df50f977945085c6a49848a8d6b3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695823298622"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695823298622"}]},"ts":"1695823298622"} 2023-09-27 14:01:38,623 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 61c37603622d4550657305878a3d0d1c 2023-09-27 14:01:38,625 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=61c37603622d4550657305878a3d0d1c, regionState=CLOSED 2023-09-27 14:01:38,626 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695823280353.61c37603622d4550657305878a3d0d1c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695823298625"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695823298625"}]},"ts":"1695823298625"} 2023-09-27 14:01:38,628 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=23 2023-09-27 14:01:38,628 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 4572df50f977945085c6a49848a8d6b3, server=jenkins-hbase9.apache.org,43797,1695823272608 in 188 msec 2023-09-27 14:01:38,630 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4572df50f977945085c6a49848a8d6b3, UNASSIGN in 200 msec 2023-09-27 14:01:38,630 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=22 2023-09-27 14:01:38,630 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 61c37603622d4550657305878a3d0d1c, server=jenkins-hbase9.apache.org,44379,1695823272702 in 193 msec 2023-09-27 14:01:38,633 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=22, resume processing ppid=21 2023-09-27 14:01:38,633 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=61c37603622d4550657305878a3d0d1c, UNASSIGN in 202 msec 2023-09-27 14:01:38,634 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695823298633"}]},"ts":"1695823298633"} 2023-09-27 14:01:38,635 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-09-27 14:01:38,672 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-09-27 14:01:38,676 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 294 msec 2023-09-27 14:01:38,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-27 14:01:38,695 INFO [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-09-27 14:01:38,700 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportWithTargetName 2023-09-27 14:01:38,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-27 14:01:38,711 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-27 14:01:38,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-09-27 14:01:38,714 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-27 14:01:38,717 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44379] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-09-27 14:01:38,721 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportWithTargetName/61c37603622d4550657305878a3d0d1c 2023-09-27 14:01:38,721 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportWithTargetName/4572df50f977945085c6a49848a8d6b3 2023-09-27 14:01:38,724 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportWithTargetName/4572df50f977945085c6a49848a8d6b3/cf, FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportWithTargetName/4572df50f977945085c6a49848a8d6b3/recovered.edits] 2023-09-27 14:01:38,724 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportWithTargetName/61c37603622d4550657305878a3d0d1c/cf, FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportWithTargetName/61c37603622d4550657305878a3d0d1c/recovered.edits] 2023-09-27 14:01:38,733 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportWithTargetName/61c37603622d4550657305878a3d0d1c/cf/34eeaa9d7a3f42269661c5221adcc29d to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/archive/data/default/testtb-testExportWithTargetName/61c37603622d4550657305878a3d0d1c/cf/34eeaa9d7a3f42269661c5221adcc29d 2023-09-27 14:01:38,733 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportWithTargetName/4572df50f977945085c6a49848a8d6b3/cf/b75261bcf9364391929de8f5384c8f6e to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/archive/data/default/testtb-testExportWithTargetName/4572df50f977945085c6a49848a8d6b3/cf/b75261bcf9364391929de8f5384c8f6e 2023-09-27 14:01:38,738 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportWithTargetName/61c37603622d4550657305878a3d0d1c/recovered.edits/9.seqid to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/archive/data/default/testtb-testExportWithTargetName/61c37603622d4550657305878a3d0d1c/recovered.edits/9.seqid 2023-09-27 14:01:38,738 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportWithTargetName/4572df50f977945085c6a49848a8d6b3/recovered.edits/9.seqid to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/archive/data/default/testtb-testExportWithTargetName/4572df50f977945085c6a49848a8d6b3/recovered.edits/9.seqid 2023-09-27 14:01:38,738 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportWithTargetName/61c37603622d4550657305878a3d0d1c 2023-09-27 14:01:38,739 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportWithTargetName/4572df50f977945085c6a49848a8d6b3 2023-09-27 14:01:38,739 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-27 14:01:38,739 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-27 14:01:38,741 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-09-27 14:01:38,746 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230927b73438c4fdb242c9b6fe2251e582dbeb to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230927b73438c4fdb242c9b6fe2251e582dbeb 2023-09-27 14:01:38,748 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230927f89d13dd4d7d43ee86898e7b18d5ef0a to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230927f89d13dd4d7d43ee86898e7b18d5ef0a 2023-09-27 14:01:38,749 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-27 14:01:38,752 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-27 14:01:38,772 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-27 14:01:38,772 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-27 14:01:38,772 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-27 14:01:38,772 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-27 14:01:38,777 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-09-27 14:01:38,780 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-09-27 14:01:38,782 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-27 14:01:38,782 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-09-27 14:01:38,782 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1695823280353.61c37603622d4550657305878a3d0d1c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695823298782"}]},"ts":"9223372036854775807"} 2023-09-27 14:01:38,782 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1695823280353.4572df50f977945085c6a49848a8d6b3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695823298782"}]},"ts":"9223372036854775807"} 2023-09-27 14:01:38,785 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-27 14:01:38,785 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 61c37603622d4550657305878a3d0d1c, NAME => 'testtb-testExportWithTargetName,,1695823280353.61c37603622d4550657305878a3d0d1c.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 4572df50f977945085c6a49848a8d6b3, NAME => 'testtb-testExportWithTargetName,1,1695823280353.4572df50f977945085c6a49848a8d6b3.', STARTKEY => '1', ENDKEY => ''}] 2023-09-27 14:01:38,785 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-09-27 14:01:38,785 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695823298785"}]},"ts":"9223372036854775807"} 2023-09-27 14:01:38,788 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-09-27 14:01:38,810 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:01:38,811 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:01:38,811 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:01:38,811 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-27 14:01:38,810 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:01:38,811 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-27 14:01:38,811 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-27 14:01:38,811 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-27 14:01:38,811 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-27 14:01:38,811 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-27 14:01:38,811 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-27 14:01:38,811 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-27 14:01:38,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-27 14:01:38,835 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-27 14:01:38,837 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 134 msec 2023-09-27 14:01:38,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-27 14:01:38,916 INFO [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-09-27 14:01:38,936 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportWithTargetName" 2023-09-27 14:01:38,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-09-27 14:01:38,942 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportWithTargetName" 2023-09-27 14:01:38,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-09-27 14:01:38,975 INFO [Listener at jenkins-hbase9.apache.org/33737] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=754 (was 707) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/cluster_b497cd91-1a8d-e480-fe2a-873529d0f364/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1724413351_17 at /127.0.0.1:41966 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5ef90b03-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/cluster_b497cd91-1a8d-e480-fe2a-873529d0f364/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2107514926) connection to jenkins-hbase9.apache.org/172.31.2.10:34087 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (2107514926) connection to jenkins-hbase9.apache.org/172.31.2.10:38575 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/cluster_b497cd91-1a8d-e480-fe2a-873529d0f364/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1724413351_17 at /127.0.0.1:35652 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/cluster_b497cd91-1a8d-e480-fe2a-873529d0f364/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1283 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1724413351_17 at /127.0.0.1:60076 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5ef90b03-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/cluster_b497cd91-1a8d-e480-fe2a-873529d0f364/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5ef90b03-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2107514926) connection to jenkins-hbase9.apache.org/172.31.2.10:40359 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5ef90b03-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/cluster_b497cd91-1a8d-e480-fe2a-873529d0f364/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_22644728_1 at /127.0.0.1:34374 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=927 (was 895) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=227 (was 209) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 165) - ProcessCount LEAK? -, AvailableMemoryMB=8935 (was 9776) 2023-09-27 14:01:38,976 WARN [Listener at jenkins-hbase9.apache.org/33737] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-09-27 14:01:38,999 INFO [Listener at jenkins-hbase9.apache.org/33737] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=754, OpenFileDescriptor=927, MaxFileDescriptor=60000, SystemLoadAverage=227, ProcessCount=168, AvailableMemoryMB=8933 2023-09-27 14:01:38,999 WARN [Listener at jenkins-hbase9.apache.org/33737] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-09-27 14:01:39,002 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-27 14:01:39,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-09-27 14:01:39,009 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-27 14:01:39,010 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-09-27 14:01:39,012 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-27 14:01:39,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-27 14:01:39,015 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemState/6b6aa83da7871fbdb6b55637ee1962a9 2023-09-27 14:01:39,015 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemState/9c0c725282ff38d1b9034a4fbf711206 2023-09-27 14:01:39,015 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemState/6b6aa83da7871fbdb6b55637ee1962a9 empty. 2023-09-27 14:01:39,016 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemState/9c0c725282ff38d1b9034a4fbf711206 empty. 2023-09-27 14:01:39,016 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemState/6b6aa83da7871fbdb6b55637ee1962a9 2023-09-27 14:01:39,016 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemState/9c0c725282ff38d1b9034a4fbf711206 2023-09-27 14:01:39,016 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-27 14:01:39,029 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-27 14:01:39,030 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6b6aa83da7871fbdb6b55637ee1962a9, NAME => 'testtb-testExportFileSystemState,,1695823299001.6b6aa83da7871fbdb6b55637ee1962a9.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp 2023-09-27 14:01:39,031 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9c0c725282ff38d1b9034a4fbf711206, NAME => 'testtb-testExportFileSystemState,1,1695823299001.9c0c725282ff38d1b9034a4fbf711206.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp 2023-09-27 14:01:39,062 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695823299001.9c0c725282ff38d1b9034a4fbf711206.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 14:01:39,063 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 9c0c725282ff38d1b9034a4fbf711206, disabling compactions & flushes 2023-09-27 14:01:39,063 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695823299001.9c0c725282ff38d1b9034a4fbf711206. 2023-09-27 14:01:39,063 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695823299001.9c0c725282ff38d1b9034a4fbf711206. 2023-09-27 14:01:39,063 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695823299001.9c0c725282ff38d1b9034a4fbf711206. after waiting 0 ms 2023-09-27 14:01:39,063 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695823299001.9c0c725282ff38d1b9034a4fbf711206. 2023-09-27 14:01:39,063 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695823299001.9c0c725282ff38d1b9034a4fbf711206. 2023-09-27 14:01:39,063 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 9c0c725282ff38d1b9034a4fbf711206: 2023-09-27 14:01:39,066 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695823299001.6b6aa83da7871fbdb6b55637ee1962a9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 14:01:39,067 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 6b6aa83da7871fbdb6b55637ee1962a9, disabling compactions & flushes 2023-09-27 14:01:39,067 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695823299001.6b6aa83da7871fbdb6b55637ee1962a9. 2023-09-27 14:01:39,067 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695823299001.6b6aa83da7871fbdb6b55637ee1962a9. 2023-09-27 14:01:39,067 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695823299001.6b6aa83da7871fbdb6b55637ee1962a9. after waiting 0 ms 2023-09-27 14:01:39,067 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695823299001.6b6aa83da7871fbdb6b55637ee1962a9. 2023-09-27 14:01:39,067 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695823299001.6b6aa83da7871fbdb6b55637ee1962a9. 2023-09-27 14:01:39,067 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 6b6aa83da7871fbdb6b55637ee1962a9: 2023-09-27 14:01:39,071 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-27 14:01:39,073 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695823299001.9c0c725282ff38d1b9034a4fbf711206.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695823299072"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695823299072"}]},"ts":"1695823299072"} 2023-09-27 14:01:39,073 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695823299001.6b6aa83da7871fbdb6b55637ee1962a9.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695823299072"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695823299072"}]},"ts":"1695823299072"} 2023-09-27 14:01:39,076 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-27 14:01:39,077 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-27 14:01:39,077 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695823299077"}]},"ts":"1695823299077"} 2023-09-27 14:01:39,079 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-09-27 14:01:39,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-27 14:01:39,126 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-09-27 14:01:39,128 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 14:01:39,128 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 14:01:39,128 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 14:01:39,128 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 14:01:39,128 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6b6aa83da7871fbdb6b55637ee1962a9, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9c0c725282ff38d1b9034a4fbf711206, ASSIGN}] 2023-09-27 14:01:39,132 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6b6aa83da7871fbdb6b55637ee1962a9, ASSIGN 2023-09-27 14:01:39,132 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9c0c725282ff38d1b9034a4fbf711206, ASSIGN 2023-09-27 14:01:39,133 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9c0c725282ff38d1b9034a4fbf711206, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,44379,1695823272702; forceNewPlan=false, retain=false 2023-09-27 14:01:39,133 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6b6aa83da7871fbdb6b55637ee1962a9, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,33659,1695823272661; forceNewPlan=false, retain=false 2023-09-27 14:01:39,283 INFO [jenkins-hbase9:32789] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-27 14:01:39,286 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=9c0c725282ff38d1b9034a4fbf711206, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:39,286 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=6b6aa83da7871fbdb6b55637ee1962a9, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:39,287 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695823299001.9c0c725282ff38d1b9034a4fbf711206.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695823299286"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695823299286"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695823299286"}]},"ts":"1695823299286"} 2023-09-27 14:01:39,287 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695823299001.6b6aa83da7871fbdb6b55637ee1962a9.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695823299286"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695823299286"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695823299286"}]},"ts":"1695823299286"} 2023-09-27 14:01:39,289 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 9c0c725282ff38d1b9034a4fbf711206, server=jenkins-hbase9.apache.org,44379,1695823272702}] 2023-09-27 14:01:39,290 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 6b6aa83da7871fbdb6b55637ee1962a9, server=jenkins-hbase9.apache.org,33659,1695823272661}] 2023-09-27 14:01:39,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-27 14:01:39,445 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:39,445 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-27 14:01:39,449 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35454, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-27 14:01:39,450 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1695823299001.9c0c725282ff38d1b9034a4fbf711206. 2023-09-27 14:01:39,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9c0c725282ff38d1b9034a4fbf711206, NAME => 'testtb-testExportFileSystemState,1,1695823299001.9c0c725282ff38d1b9034a4fbf711206.', STARTKEY => '1', ENDKEY => ''} 2023-09-27 14:01:39,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1695823299001.9c0c725282ff38d1b9034a4fbf711206. service=AccessControlService 2023-09-27 14:01:39,452 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 14:01:39,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 9c0c725282ff38d1b9034a4fbf711206 2023-09-27 14:01:39,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695823299001.9c0c725282ff38d1b9034a4fbf711206.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 14:01:39,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 9c0c725282ff38d1b9034a4fbf711206 2023-09-27 14:01:39,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 9c0c725282ff38d1b9034a4fbf711206 2023-09-27 14:01:39,455 INFO [StoreOpener-9c0c725282ff38d1b9034a4fbf711206-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9c0c725282ff38d1b9034a4fbf711206 2023-09-27 14:01:39,456 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1695823299001.6b6aa83da7871fbdb6b55637ee1962a9. 2023-09-27 14:01:39,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6b6aa83da7871fbdb6b55637ee1962a9, NAME => 'testtb-testExportFileSystemState,,1695823299001.6b6aa83da7871fbdb6b55637ee1962a9.', STARTKEY => '', ENDKEY => '1'} 2023-09-27 14:01:39,456 DEBUG [StoreOpener-9c0c725282ff38d1b9034a4fbf711206-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemState/9c0c725282ff38d1b9034a4fbf711206/cf 2023-09-27 14:01:39,456 DEBUG [StoreOpener-9c0c725282ff38d1b9034a4fbf711206-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemState/9c0c725282ff38d1b9034a4fbf711206/cf 2023-09-27 14:01:39,457 INFO [StoreOpener-9c0c725282ff38d1b9034a4fbf711206-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9c0c725282ff38d1b9034a4fbf711206 columnFamilyName cf 2023-09-27 14:01:39,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1695823299001.6b6aa83da7871fbdb6b55637ee1962a9. service=AccessControlService 2023-09-27 14:01:39,457 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 14:01:39,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 6b6aa83da7871fbdb6b55637ee1962a9 2023-09-27 14:01:39,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695823299001.6b6aa83da7871fbdb6b55637ee1962a9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 14:01:39,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 6b6aa83da7871fbdb6b55637ee1962a9 2023-09-27 14:01:39,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 6b6aa83da7871fbdb6b55637ee1962a9 2023-09-27 14:01:39,458 INFO [StoreOpener-9c0c725282ff38d1b9034a4fbf711206-1] regionserver.HStore(310): Store=9c0c725282ff38d1b9034a4fbf711206/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 14:01:39,460 INFO [StoreOpener-6b6aa83da7871fbdb6b55637ee1962a9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6b6aa83da7871fbdb6b55637ee1962a9 2023-09-27 14:01:39,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemState/9c0c725282ff38d1b9034a4fbf711206 2023-09-27 14:01:39,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemState/9c0c725282ff38d1b9034a4fbf711206 2023-09-27 14:01:39,461 DEBUG [StoreOpener-6b6aa83da7871fbdb6b55637ee1962a9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemState/6b6aa83da7871fbdb6b55637ee1962a9/cf 2023-09-27 14:01:39,461 DEBUG [StoreOpener-6b6aa83da7871fbdb6b55637ee1962a9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemState/6b6aa83da7871fbdb6b55637ee1962a9/cf 2023-09-27 14:01:39,462 INFO [StoreOpener-6b6aa83da7871fbdb6b55637ee1962a9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6b6aa83da7871fbdb6b55637ee1962a9 columnFamilyName cf 2023-09-27 14:01:39,463 INFO [StoreOpener-6b6aa83da7871fbdb6b55637ee1962a9-1] regionserver.HStore(310): Store=6b6aa83da7871fbdb6b55637ee1962a9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 14:01:39,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemState/6b6aa83da7871fbdb6b55637ee1962a9 2023-09-27 14:01:39,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemState/6b6aa83da7871fbdb6b55637ee1962a9 2023-09-27 14:01:39,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 9c0c725282ff38d1b9034a4fbf711206 2023-09-27 14:01:39,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemState/9c0c725282ff38d1b9034a4fbf711206/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 14:01:39,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 6b6aa83da7871fbdb6b55637ee1962a9 2023-09-27 14:01:39,469 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 9c0c725282ff38d1b9034a4fbf711206; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61214390, jitterRate=-0.08783450722694397}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 14:01:39,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 9c0c725282ff38d1b9034a4fbf711206: 2023-09-27 14:01:39,471 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1695823299001.9c0c725282ff38d1b9034a4fbf711206., pid=30, masterSystemTime=1695823299442 2023-09-27 14:01:39,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemState/6b6aa83da7871fbdb6b55637ee1962a9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 14:01:39,473 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 6b6aa83da7871fbdb6b55637ee1962a9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62722058, jitterRate=-0.06536850333213806}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 14:01:39,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 6b6aa83da7871fbdb6b55637ee1962a9: 2023-09-27 14:01:39,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1695823299001.9c0c725282ff38d1b9034a4fbf711206. 2023-09-27 14:01:39,473 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1695823299001.9c0c725282ff38d1b9034a4fbf711206. 2023-09-27 14:01:39,474 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=9c0c725282ff38d1b9034a4fbf711206, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:39,474 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1695823299001.6b6aa83da7871fbdb6b55637ee1962a9., pid=31, masterSystemTime=1695823299445 2023-09-27 14:01:39,476 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1695823299001.9c0c725282ff38d1b9034a4fbf711206.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695823299474"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695823299474"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695823299474"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695823299474"}]},"ts":"1695823299474"} 2023-09-27 14:01:39,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1695823299001.6b6aa83da7871fbdb6b55637ee1962a9. 2023-09-27 14:01:39,480 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1695823299001.6b6aa83da7871fbdb6b55637ee1962a9. 2023-09-27 14:01:39,481 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=6b6aa83da7871fbdb6b55637ee1962a9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:39,482 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1695823299001.6b6aa83da7871fbdb6b55637ee1962a9.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695823299481"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695823299481"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695823299481"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695823299481"}]},"ts":"1695823299481"} 2023-09-27 14:01:39,484 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=29 2023-09-27 14:01:39,484 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 9c0c725282ff38d1b9034a4fbf711206, server=jenkins-hbase9.apache.org,44379,1695823272702 in 190 msec 2023-09-27 14:01:39,486 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9c0c725282ff38d1b9034a4fbf711206, ASSIGN in 356 msec 2023-09-27 14:01:39,489 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=28 2023-09-27 14:01:39,489 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 6b6aa83da7871fbdb6b55637ee1962a9, server=jenkins-hbase9.apache.org,33659,1695823272661 in 194 msec 2023-09-27 14:01:39,492 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=28, resume processing ppid=27 2023-09-27 14:01:39,492 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6b6aa83da7871fbdb6b55637ee1962a9, ASSIGN in 361 msec 2023-09-27 14:01:39,493 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-27 14:01:39,493 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695823299493"}]},"ts":"1695823299493"} 2023-09-27 14:01:39,495 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-09-27 14:01:39,512 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-27 14:01:39,512 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-09-27 14:01:39,514 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44379] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-27 14:01:39,534 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:01:39,534 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:01:39,534 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:01:39,534 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:01:39,565 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-27 14:01:39,565 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-27 14:01:39,565 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-27 14:01:39,565 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-27 14:01:39,567 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 561 msec 2023-09-27 14:01:39,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-27 14:01:39,616 INFO [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-09-27 14:01:39,619 DEBUG [Listener at jenkins-hbase9.apache.org/33737] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-27 14:01:39,620 DEBUG [Listener at jenkins-hbase9.apache.org/33737] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695823299001.6b6aa83da7871fbdb6b55637ee1962a9. 2023-09-27 14:01:39,622 INFO [Listener at jenkins-hbase9.apache.org/33737] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 14:01:39,632 DEBUG [hconnection-0x1eb93e1b-shared-pool-10] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 14:01:39,638 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35464, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 14:01:39,645 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 14:01:39,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695823299645 (current time:1695823299645). 2023-09-27 14:01:39,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 14:01:39,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(139): Connect 0x50ad7108 to 127.0.0.1:60071 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 14:01:39,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d0b9576, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 14:01:39,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 14:01:39,722 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:32910, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 14:01:39,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x50ad7108 to 127.0.0.1:60071 2023-09-27 14:01:39,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 14:01:39,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(139): Connect 0x1f1db1ba to 127.0.0.1:60071 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 14:01:39,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2483a660, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 14:01:39,790 DEBUG [hconnection-0x45c237a3-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 14:01:39,794 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:32920, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 14:01:39,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 14:01:39,800 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45110, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 14:01:39,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1f1db1ba to 127.0.0.1:60071 2023-09-27 14:01:39,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 14:01:39,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-27 14:01:39,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 14:01:39,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 14:01:39,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-27 14:01:39,806 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-27 14:01:39,807 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695823899807 2023-09-27 14:01:39,807 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-27 14:01:39,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 14:01:39,809 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 14:01:39,809 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 14:01:39,810 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-27 14:01:39,811 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-27 14:01:39,812 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-09-27 14:01:39,813 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-27 14:01:39,814 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695823899814 2023-09-27 14:01:39,834 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:39,834 INFO [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-09-27 14:01:39,834 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:01:39,835 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-09-27 14:01:39,836 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-27 14:01:39,836 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:39,836 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:39,856 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:01:39,856 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:01:39,856 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:01:39,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:01:39,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:01:39,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:01:39,856 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:39,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:01:39,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:01:39,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:01:39,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:39,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:39,857 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:39,857 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:39,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:39,858 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:39,858 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:39,858 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 14:01:39,858 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:39,858 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:39,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-27 14:01:39,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:39,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-27 14:01:39,858 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-27 14:01:39,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:39,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-27 14:01:39,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:39,859 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-27 14:01:39,859 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-27 14:01:39,859 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:39,859 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-27 14:01:39,859 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:39,859 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:39,859 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:01:39,859 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-27 14:01:39,860 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-27 14:01:39,859 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-27 14:01:39,861 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-27 14:01:39,860 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:01:39,861 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44379,1695823272702' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-27 14:01:39,862 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-27 14:01:39,861 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:01:39,862 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-27 14:01:39,863 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-27 14:01:39,863 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-27 14:01:39,863 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33659,1695823272661' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-27 14:01:39,863 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,43797,1695823272608' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-27 14:01:39,887 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:39,887 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:39,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:39,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:01:39,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:01:39,909 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 14:01:39,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-27 14:01:39,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-27 14:01:39,911 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 14:01:40,049 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:01:40,050 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:40,049 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,049 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,050 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 14:01:40,050 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,050 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 14:01:40,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:01:40,050 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,050 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 14:01:40,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:40,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:40,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:40,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:01:40,052 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44379,1695823272702' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-27 14:01:40,052 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@52b47887[Count = 1] remaining members to acquire global barrier 2023-09-27 14:01:40,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:40,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:01:40,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:01:40,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:01:40,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:01:40,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:40,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:40,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:40,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:01:40,054 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,33659,1695823272661' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-27 14:01:40,054 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@52b47887[Count = 0] remaining members to acquire global barrier 2023-09-27 14:01:40,054 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-27 14:01:40,054 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,072 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,072 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,072 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,072 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-27 14:01:40,072 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:40,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,073 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-27 14:01:40,073 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-27 14:01:40,073 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-27 14:01:40,073 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695823299001.9c0c725282ff38d1b9034a4fbf711206. 2023-09-27 14:01:40,073 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:40,073 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 14:01:40,073 DEBUG [rs(jenkins-hbase9.apache.org,33659,1695823272661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695823299001.6b6aa83da7871fbdb6b55637ee1962a9. 2023-09-27 14:01:40,073 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 14:01:40,073 DEBUG [rs(jenkins-hbase9.apache.org,33659,1695823272661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695823299001.6b6aa83da7871fbdb6b55637ee1962a9. started... 2023-09-27 14:01:40,073 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 14:01:40,073 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695823299001.9c0c725282ff38d1b9034a4fbf711206. started... 2023-09-27 14:01:40,073 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 14:01:40,073 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 14:01:40,073 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,43797,1695823272608' in zk 2023-09-27 14:01:40,075 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9c0c725282ff38d1b9034a4fbf711206: 2023-09-27 14:01:40,075 DEBUG [rs(jenkins-hbase9.apache.org,33659,1695823272661)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6b6aa83da7871fbdb6b55637ee1962a9: 2023-09-27 14:01:40,075 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695823299001.9c0c725282ff38d1b9034a4fbf711206.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,075 DEBUG [rs(jenkins-hbase9.apache.org,33659,1695823272661)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695823299001.6b6aa83da7871fbdb6b55637ee1962a9.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,075 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 14:01:40,075 DEBUG [rs(jenkins-hbase9.apache.org,33659,1695823272661)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 14:01:40,075 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 14:01:40,075 DEBUG [rs(jenkins-hbase9.apache.org,33659,1695823272661)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 14:01:40,099 DEBUG [rs(jenkins-hbase9.apache.org,33659,1695823272661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695823299001.6b6aa83da7871fbdb6b55637ee1962a9. completed. 2023-09-27 14:01:40,099 DEBUG [rs(jenkins-hbase9.apache.org,33659,1695823272661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695823299001.6b6aa83da7871fbdb6b55637ee1962a9. 2023-09-27 14:01:40,099 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 14:01:40,099 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 14:01:40,099 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:40,099 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-27 14:01:40,099 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,33659,1695823272661' in zk 2023-09-27 14:01:40,111 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 14:01:40,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-27 14:01:40,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-27 14:01:40,112 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-27 14:01:40,118 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-27 14:01:40,118 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:01:40,118 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-27 14:01:40,141 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-27 14:01:40,141 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:40,141 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:01:40,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:40,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:01:40,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:01:40,141 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-27 14:01:40,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:01:40,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:01:40,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:40,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:40,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:40,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:01:40,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:40,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:40,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,33659,1695823272661': 2023-09-27 14:01:40,148 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,33659,1695823272661' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-27 14:01:40,413 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 14:01:40,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-27 14:01:40,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-27 14:01:40,414 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-09-27 14:01:40,499 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695823299001.9c0c725282ff38d1b9034a4fbf711206. completed. 2023-09-27 14:01:40,499 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695823299001.9c0c725282ff38d1b9034a4fbf711206. 2023-09-27 14:01:40,499 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 14:01:40,499 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 14:01:40,499 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:40,499 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-27 14:01:40,499 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,44379,1695823272702' in zk 2023-09-27 14:01:40,526 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-27 14:01:40,526 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:40,526 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:01:40,526 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-27 14:01:40,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:40,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:01:40,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:01:40,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:01:40,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:01:40,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:40,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:40,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:40,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:01:40,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:40,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:40,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:40,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,44379,1695823272702': 2023-09-27 14:01:40,532 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44379,1695823272702' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-27 14:01:40,532 INFO [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-09-27 14:01:40,532 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 14:01:40,532 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 14:01:40,532 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,532 INFO [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 14:01:40,549 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,549 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,549 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,549 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,549 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:01:40,549 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:01:40,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:01:40,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:01:40,550 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:40,549 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:01:40,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:01:40,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:01:40,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:01:40,550 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:40,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:01:40,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:01:40,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:01:40,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:01:40,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,551 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:40,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:01:40,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:40,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:40,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:40,553 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:40,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:01:40,553 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:40,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,553 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:40,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:40,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:40,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:40,588 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:01:40,588 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:40,588 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:01:40,588 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,588 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:40,588 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:40,588 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,588 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:40,588 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,588 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:01:40,588 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:01:40,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:01:40,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:01:40,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:01:40,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:01:40,588 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:01:40,588 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,588 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:01:40,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:01:40,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:01:40,588 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:01:40,588 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:40,589 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-27 14:01:40,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:01:40,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:01:40,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:01:40,590 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:40,591 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:01:40,591 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 14:01:40,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:01:40,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:01:40,591 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,591 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,592 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-27 14:01:40,608 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,609 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,634 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,635 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-27 14:01:40,635 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,636 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:40,636 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695823299807Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695823300608 (+801 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1695823300608Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1695823300608Writing data manifest for emptySnaptb0-testExportFileSystemState at 1695823300613 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1695823300626 (+13 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695823300635 (+9 ms) 2023-09-27 14:01:40,639 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-27 14:01:40,641 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 830 msec 2023-09-27 14:01:40,914 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 14:01:40,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-27 14:01:40,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 14:01:40,921 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33659] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1695823299001.6b6aa83da7871fbdb6b55637ee1962a9. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 14:01:40,923 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44379] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1695823299001.9c0c725282ff38d1b9034a4fbf711206. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 14:01:40,927 DEBUG [Listener at jenkins-hbase9.apache.org/33737] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-27 14:01:40,927 DEBUG [Listener at jenkins-hbase9.apache.org/33737] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695823299001.6b6aa83da7871fbdb6b55637ee1962a9. 2023-09-27 14:01:40,927 INFO [Listener at jenkins-hbase9.apache.org/33737] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 14:01:40,940 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 14:01:40,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695823300940 (current time:1695823300940). 2023-09-27 14:01:40,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 14:01:40,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(139): Connect 0x4868f8c3 to 127.0.0.1:60071 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 14:01:40,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5dc1afba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 14:01:40,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 14:01:40,971 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:32932, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 14:01:40,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4868f8c3 to 127.0.0.1:60071 2023-09-27 14:01:40,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 14:01:40,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(139): Connect 0x2c2ad1b1 to 127.0.0.1:60071 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 14:01:40,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73675da3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 14:01:40,998 DEBUG [hconnection-0x6c1c75de-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 14:01:40,999 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:32934, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 14:01:41,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 14:01:41,007 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45112, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 14:01:41,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c2ad1b1 to 127.0.0.1:60071 2023-09-27 14:01:41,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 14:01:41,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-27 14:01:41,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 14:01:41,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 14:01:41,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-27 14:01:41,013 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-27 14:01:41,014 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695823901014 2023-09-27 14:01:41,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 14:01:41,014 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-27 14:01:41,015 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 14:01:41,015 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 14:01:41,017 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-27 14:01:41,017 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-27 14:01:41,019 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-09-27 14:01:41,021 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-27 14:01:41,021 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695823901021 2023-09-27 14:01:41,032 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-09-27 14:01:41,032 INFO [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-09-27 14:01:41,032 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:01:41,034 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-09-27 14:01:41,034 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-27 14:01:41,034 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,034 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,037 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:01:41,037 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:41,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:01:41,037 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:01:41,037 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:01:41,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:01:41,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:01:41,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:01:41,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:01:41,038 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:41,038 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:41,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:01:41,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,038 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:41,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,038 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 14:01:41,038 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,039 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,039 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-27 14:01:41,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-27 14:01:41,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,039 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-27 14:01:41,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-27 14:01:41,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,039 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-27 14:01:41,039 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-27 14:01:41,039 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-27 14:01:41,039 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-27 14:01:41,039 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:01:41,039 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-27 14:01:41,040 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-27 14:01:41,040 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:01:41,041 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-27 14:01:41,041 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-27 14:01:41,042 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-27 14:01:41,042 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-27 14:01:41,042 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33659,1695823272661' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-27 14:01:41,042 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-27 14:01:41,042 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-27 14:01:41,042 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:01:41,042 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,43797,1695823272608' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-27 14:01:41,043 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-27 14:01:41,043 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-27 14:01:41,043 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44379,1695823272702' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-27 14:01:41,045 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,045 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:41,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:41,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:01:41,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:01:41,046 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,046 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:41,046 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:01:41,046 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,046 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 14:01:41,046 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,046 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 14:01:41,046 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,046 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 14:01:41,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:01:41,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-27 14:01:41,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:41,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:41,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:41,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:01:41,048 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,33659,1695823272661' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-27 14:01:41,048 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76caae03[Count = 1] remaining members to acquire global barrier 2023-09-27 14:01:41,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:41,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:01:41,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:01:41,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:01:41,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:01:41,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-27 14:01:41,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:41,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:41,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:41,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:01:41,050 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44379,1695823272702' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-27 14:01:41,051 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76caae03[Count = 0] remaining members to acquire global barrier 2023-09-27 14:01:41,051 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-27 14:01:41,051 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,052 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,052 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,052 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,052 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-27 14:01:41,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,052 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-27 14:01:41,052 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:41,052 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,43797,1695823272608' in zk 2023-09-27 14:01:41,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,052 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-27 14:01:41,053 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-27 14:01:41,053 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:41,053 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 14:01:41,053 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 14:01:41,053 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 14:01:41,053 DEBUG [rs(jenkins-hbase9.apache.org,33659,1695823272661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695823299001.6b6aa83da7871fbdb6b55637ee1962a9. 2023-09-27 14:01:41,053 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 14:01:41,053 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 14:01:41,053 DEBUG [rs(jenkins-hbase9.apache.org,33659,1695823272661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695823299001.6b6aa83da7871fbdb6b55637ee1962a9. started... 2023-09-27 14:01:41,053 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695823299001.9c0c725282ff38d1b9034a4fbf711206. 2023-09-27 14:01:41,053 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695823299001.9c0c725282ff38d1b9034a4fbf711206. started... 2023-09-27 14:01:41,053 INFO [rs(jenkins-hbase9.apache.org,33659,1695823272661)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6b6aa83da7871fbdb6b55637ee1962a9 1/1 column families, dataSize=333 B heapSize=976 B 2023-09-27 14:01:41,053 INFO [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9c0c725282ff38d1b9034a4fbf711206 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-09-27 14:01:41,054 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-27 14:01:41,055 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:01:41,055 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-27 14:01:41,094 INFO [rs(jenkins-hbase9.apache.org,33659,1695823272661)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230927c37529a5951346db88af5f0c290e479c to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230927c37529a5951346db88af5f0c290e479c 2023-09-27 14:01:41,095 INFO [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230927c38c846df22345d0a6f5d8ebb923aa1e to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230927c38c846df22345d0a6f5d8ebb923aa1e 2023-09-27 14:01:41,116 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 14:01:41,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-27 14:01:41,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-27 14:01:41,126 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 14:01:41,127 INFO [rs(jenkins-hbase9.apache.org,33659,1695823272661)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemState/6b6aa83da7871fbdb6b55637ee1962a9/.tmp/cf/03e61d59dcc6439bab50c623e3298b75 2023-09-27 14:01:41,127 INFO [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemState/9c0c725282ff38d1b9034a4fbf711206/.tmp/cf/694ee5eb73d9427f94d9a6b68c619691 2023-09-27 14:01:41,136 DEBUG [rs(jenkins-hbase9.apache.org,33659,1695823272661)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemState/6b6aa83da7871fbdb6b55637ee1962a9/.tmp/cf/03e61d59dcc6439bab50c623e3298b75 as hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemState/6b6aa83da7871fbdb6b55637ee1962a9/cf/03e61d59dcc6439bab50c623e3298b75 2023-09-27 14:01:41,137 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemState/9c0c725282ff38d1b9034a4fbf711206/.tmp/cf/694ee5eb73d9427f94d9a6b68c619691 as hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemState/9c0c725282ff38d1b9034a4fbf711206/cf/694ee5eb73d9427f94d9a6b68c619691 2023-09-27 14:01:41,145 INFO [rs(jenkins-hbase9.apache.org,33659,1695823272661)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemState/6b6aa83da7871fbdb6b55637ee1962a9/cf/03e61d59dcc6439bab50c623e3298b75, entries=5, sequenceid=6, filesize=5.7 K 2023-09-27 14:01:41,146 INFO [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemState/9c0c725282ff38d1b9034a4fbf711206/cf/694ee5eb73d9427f94d9a6b68c619691, entries=45, sequenceid=6, filesize=12.5 K 2023-09-27 14:01:41,147 INFO [rs(jenkins-hbase9.apache.org,33659,1695823272661)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 6b6aa83da7871fbdb6b55637ee1962a9 in 93ms, sequenceid=6, compaction requested=false 2023-09-27 14:01:41,147 DEBUG [rs(jenkins-hbase9.apache.org,33659,1695823272661)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-27 14:01:41,147 INFO [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 9c0c725282ff38d1b9034a4fbf711206 in 94ms, sequenceid=6, compaction requested=false 2023-09-27 14:01:41,147 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-27 14:01:41,151 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9c0c725282ff38d1b9034a4fbf711206: 2023-09-27 14:01:41,151 DEBUG [rs(jenkins-hbase9.apache.org,33659,1695823272661)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6b6aa83da7871fbdb6b55637ee1962a9: 2023-09-27 14:01:41,151 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695823299001.9c0c725282ff38d1b9034a4fbf711206.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-27 14:01:41,151 DEBUG [rs(jenkins-hbase9.apache.org,33659,1695823272661)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695823299001.6b6aa83da7871fbdb6b55637ee1962a9.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-27 14:01:41,151 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 14:01:41,151 DEBUG [rs(jenkins-hbase9.apache.org,33659,1695823272661)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 14:01:41,151 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemState/9c0c725282ff38d1b9034a4fbf711206/cf/694ee5eb73d9427f94d9a6b68c619691] hfiles 2023-09-27 14:01:41,151 DEBUG [rs(jenkins-hbase9.apache.org,33659,1695823272661)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemState/6b6aa83da7871fbdb6b55637ee1962a9/cf/03e61d59dcc6439bab50c623e3298b75] hfiles 2023-09-27 14:01:41,151 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemState/9c0c725282ff38d1b9034a4fbf711206/cf/694ee5eb73d9427f94d9a6b68c619691 for snapshot=snaptb0-testExportFileSystemState 2023-09-27 14:01:41,151 DEBUG [rs(jenkins-hbase9.apache.org,33659,1695823272661)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemState/6b6aa83da7871fbdb6b55637ee1962a9/cf/03e61d59dcc6439bab50c623e3298b75 for snapshot=snaptb0-testExportFileSystemState 2023-09-27 14:01:41,167 DEBUG [rs(jenkins-hbase9.apache.org,33659,1695823272661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695823299001.6b6aa83da7871fbdb6b55637ee1962a9. completed. 2023-09-27 14:01:41,167 DEBUG [rs(jenkins-hbase9.apache.org,33659,1695823272661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695823299001.6b6aa83da7871fbdb6b55637ee1962a9. 2023-09-27 14:01:41,168 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 14:01:41,168 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 14:01:41,168 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:41,168 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-27 14:01:41,168 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,33659,1695823272661' in zk 2023-09-27 14:01:41,172 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-27 14:01:41,172 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:41,172 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:01:41,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:41,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:01:41,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:01:41,172 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-27 14:01:41,172 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695823299001.9c0c725282ff38d1b9034a4fbf711206. completed. 2023-09-27 14:01:41,175 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695823299001.9c0c725282ff38d1b9034a4fbf711206. 2023-09-27 14:01:41,175 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 14:01:41,175 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 14:01:41,175 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:41,175 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-27 14:01:41,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:01:41,175 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,44379,1695823272702' in zk 2023-09-27 14:01:41,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:01:41,177 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-27 14:01:41,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-27 14:01:41,177 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:01:41,177 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:41,177 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-27 14:01:41,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:41,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:41,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:41,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:01:41,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-27 14:01:41,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:41,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:41,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:41,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,33659,1695823272661': 2023-09-27 14:01:41,181 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,33659,1695823272661' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-27 14:01:41,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:41,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:01:41,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:01:41,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:01:41,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:01:41,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-27 14:01:41,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:41,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:41,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:41,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:01:41,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-27 14:01:41,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:41,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:41,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:41,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,44379,1695823272702': 2023-09-27 14:01:41,184 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44379,1695823272702' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-27 14:01:41,184 INFO [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-09-27 14:01:41,184 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 14:01:41,184 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 14:01:41,185 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-09-27 14:01:41,185 INFO [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 14:01:41,187 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,187 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,188 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:01:41,188 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,187 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,190 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:01:41,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:01:41,190 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:01:41,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:01:41,190 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:41,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:01:41,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:01:41,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,190 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:41,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:01:41,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:01:41,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:01:41,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:01:41,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:01:41,191 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:41,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-27 14:01:41,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:01:41,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-27 14:01:41,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:41,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:41,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:41,194 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:41,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:01:41,194 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:41,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-27 14:01:41,194 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:41,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:41,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:41,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:41,198 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:41,198 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,198 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:41,198 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:01:41,198 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:01:41,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:01:41,198 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:01:41,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:01:41,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:01:41,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:01:41,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:01:41,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:01:41,198 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:41,199 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,199 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:41,199 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,199 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:41,199 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:41,199 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,199 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,201 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:01:41,201 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:01:41,201 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:01:41,201 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-09-27 14:01:41,201 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:01:41,202 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-27 14:01:41,202 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-27 14:01:41,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:01:41,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:01:41,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:01:41,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:01:41,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:01:41,204 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 14:01:41,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:01:41,205 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230927c38c846df22345d0a6f5d8ebb923aa1e, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230927c37529a5951346db88af5f0c290e479c] mob files 2023-09-27 14:01:41,205 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230927c38c846df22345d0a6f5d8ebb923aa1e 2023-09-27 14:01:41,205 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230927c37529a5951346db88af5f0c290e479c 2023-09-27 14:01:41,216 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-09-27 14:01:41,217 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,253 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,254 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-27 14:01:41,254 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,255 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,255 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695823301014Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695823301216 (+202 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1695823301216Loading Region manifests for snaptb0-testExportFileSystemState at 1695823301217 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemState at 1695823301224 (+7 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1695823301244 (+20 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695823301254 (+10 ms) 2023-09-27 14:01:41,257 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-27 14:01:41,259 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 242 msec 2023-09-27 14:01:41,327 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 14:01:41,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-27 14:01:41,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 14:01:41,328 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823301328 2023-09-27 14:01:41,329 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:46363, tgtDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823301328, rawTgtDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823301328, srcFsUri=hdfs://localhost:46363, srcDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30 2023-09-27 14:01:41,359 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:46363, inputRoot=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30 2023-09-27 14:01:41,360 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2140686861_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823301328, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823301328/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,360 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:46363, inputRoot=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30, snapshotDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-09-27 14:01:41,376 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823301328/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-27 14:01:41,406 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-27 14:01:41,406 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-27 14:01:41,407 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-27 14:01:41,407 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-27 14:01:42,319 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/hadoop-4302930416611471897.jar 2023-09-27 14:01:42,320 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-27 14:01:42,320 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-27 14:01:42,387 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/hadoop-9179590437234621205.jar 2023-09-27 14:01:42,388 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-27 14:01:42,388 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-27 14:01:42,389 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-27 14:01:42,389 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-27 14:01:42,389 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-27 14:01:42,390 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-27 14:01:42,390 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-27 14:01:42,390 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-27 14:01:42,391 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-27 14:01:42,391 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-27 14:01:42,391 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-27 14:01:42,392 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-27 14:01:42,392 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-27 14:01:42,393 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-27 14:01:42,393 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-27 14:01:42,394 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-27 14:01:42,394 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 14:01:42,395 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 14:01:42,395 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 14:01:42,395 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 14:01:42,396 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 14:01:42,396 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 14:01:42,397 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 14:01:42,688 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695823279135_0001_000001 (auth:SIMPLE) 2023-09-27 14:01:43,269 WARN [Listener at jenkins-hbase9.apache.org/33737] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-27 14:01:43,272 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-09-27 14:01:43,274 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-27 14:01:43,347 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 14:01:43,347 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 14:01:43,477 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695823279135_0002_000001 (auth:SIMPLE) 2023-09-27 14:01:44,247 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-27 14:01:47,855 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695823279135_0002_000001 (auth:SIMPLE) 2023-09-27 14:01:50,113 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695823279135_0002_000001 (auth:SIMPLE) 2023-09-27 14:01:52,772 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695823279135_0002_000001 (auth:SIMPLE) 2023-09-27 14:01:54,475 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-27 14:01:54,476 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-27 14:01:54,485 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-09-27 14:01:54,485 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-27 14:01:54,486 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-27 14:01:54,486 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1724413351_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-27 14:01:54,486 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(367): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-27 14:01:54,487 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(367): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-27 14:01:54,487 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1724413351_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823301328/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823301328/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-27 14:01:54,487 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(367): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823301328/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-27 14:01:54,487 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(367): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823301328/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-27 14:01:54,494 INFO [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-09-27 14:01:54,495 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemState 2023-09-27 14:01:54,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-09-27 14:01:54,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-27 14:01:54,500 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695823314500"}]},"ts":"1695823314500"} 2023-09-27 14:01:54,501 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-09-27 14:01:54,503 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-09-27 14:01:54,504 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6b6aa83da7871fbdb6b55637ee1962a9, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9c0c725282ff38d1b9034a4fbf711206, UNASSIGN}] 2023-09-27 14:01:54,506 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9c0c725282ff38d1b9034a4fbf711206, UNASSIGN 2023-09-27 14:01:54,506 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6b6aa83da7871fbdb6b55637ee1962a9, UNASSIGN 2023-09-27 14:01:54,507 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=9c0c725282ff38d1b9034a4fbf711206, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:54,507 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=6b6aa83da7871fbdb6b55637ee1962a9, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:54,507 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695823299001.9c0c725282ff38d1b9034a4fbf711206.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695823314507"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695823314507"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695823314507"}]},"ts":"1695823314507"} 2023-09-27 14:01:54,507 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695823299001.6b6aa83da7871fbdb6b55637ee1962a9.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695823314507"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695823314507"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695823314507"}]},"ts":"1695823314507"} 2023-09-27 14:01:54,509 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure 9c0c725282ff38d1b9034a4fbf711206, server=jenkins-hbase9.apache.org,44379,1695823272702}] 2023-09-27 14:01:54,510 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 6b6aa83da7871fbdb6b55637ee1962a9, server=jenkins-hbase9.apache.org,33659,1695823272661}] 2023-09-27 14:01:54,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-27 14:01:54,660 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 9c0c725282ff38d1b9034a4fbf711206 2023-09-27 14:01:54,660 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 9c0c725282ff38d1b9034a4fbf711206, disabling compactions & flushes 2023-09-27 14:01:54,661 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695823299001.9c0c725282ff38d1b9034a4fbf711206. 2023-09-27 14:01:54,661 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695823299001.9c0c725282ff38d1b9034a4fbf711206. 2023-09-27 14:01:54,661 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695823299001.9c0c725282ff38d1b9034a4fbf711206. after waiting 0 ms 2023-09-27 14:01:54,661 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695823299001.9c0c725282ff38d1b9034a4fbf711206. 2023-09-27 14:01:54,665 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 6b6aa83da7871fbdb6b55637ee1962a9 2023-09-27 14:01:54,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 6b6aa83da7871fbdb6b55637ee1962a9, disabling compactions & flushes 2023-09-27 14:01:54,665 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695823299001.6b6aa83da7871fbdb6b55637ee1962a9. 2023-09-27 14:01:54,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695823299001.6b6aa83da7871fbdb6b55637ee1962a9. 2023-09-27 14:01:54,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695823299001.6b6aa83da7871fbdb6b55637ee1962a9. after waiting 0 ms 2023-09-27 14:01:54,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695823299001.6b6aa83da7871fbdb6b55637ee1962a9. 2023-09-27 14:01:54,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemState/9c0c725282ff38d1b9034a4fbf711206/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 14:01:54,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemState/6b6aa83da7871fbdb6b55637ee1962a9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 14:01:54,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 14:01:54,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 14:01:54,678 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695823299001.9c0c725282ff38d1b9034a4fbf711206. 2023-09-27 14:01:54,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 9c0c725282ff38d1b9034a4fbf711206: 2023-09-27 14:01:54,679 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695823299001.6b6aa83da7871fbdb6b55637ee1962a9. 2023-09-27 14:01:54,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 6b6aa83da7871fbdb6b55637ee1962a9: 2023-09-27 14:01:54,681 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 9c0c725282ff38d1b9034a4fbf711206 2023-09-27 14:01:54,681 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=9c0c725282ff38d1b9034a4fbf711206, regionState=CLOSED 2023-09-27 14:01:54,681 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695823299001.9c0c725282ff38d1b9034a4fbf711206.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695823314681"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695823314681"}]},"ts":"1695823314681"} 2023-09-27 14:01:54,682 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 6b6aa83da7871fbdb6b55637ee1962a9 2023-09-27 14:01:54,682 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=6b6aa83da7871fbdb6b55637ee1962a9, regionState=CLOSED 2023-09-27 14:01:54,682 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695823299001.6b6aa83da7871fbdb6b55637ee1962a9.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695823314682"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695823314682"}]},"ts":"1695823314682"} 2023-09-27 14:01:54,686 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=38 2023-09-27 14:01:54,686 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure 9c0c725282ff38d1b9034a4fbf711206, server=jenkins-hbase9.apache.org,44379,1695823272702 in 174 msec 2023-09-27 14:01:54,687 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=37 2023-09-27 14:01:54,687 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 6b6aa83da7871fbdb6b55637ee1962a9, server=jenkins-hbase9.apache.org,33659,1695823272661 in 174 msec 2023-09-27 14:01:54,687 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9c0c725282ff38d1b9034a4fbf711206, UNASSIGN in 182 msec 2023-09-27 14:01:54,689 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-09-27 14:01:54,689 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6b6aa83da7871fbdb6b55637ee1962a9, UNASSIGN in 183 msec 2023-09-27 14:01:54,690 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695823314690"}]},"ts":"1695823314690"} 2023-09-27 14:01:54,691 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-09-27 14:01:54,693 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-09-27 14:01:54,696 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 199 msec 2023-09-27 14:01:54,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-27 14:01:54,803 INFO [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-09-27 14:01:54,804 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemState 2023-09-27 14:01:54,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-27 14:01:54,808 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-27 14:01:54,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-09-27 14:01:54,809 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-27 14:01:54,810 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44379] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-09-27 14:01:54,814 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-27 14:01:54,814 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-27 14:01:54,814 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-27 14:01:54,814 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-27 14:01:54,814 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemState/6b6aa83da7871fbdb6b55637ee1962a9 2023-09-27 14:01:54,814 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemState/9c0c725282ff38d1b9034a4fbf711206 2023-09-27 14:01:54,814 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-27 14:01:54,814 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-27 14:01:54,814 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-27 14:01:54,814 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-27 14:01:54,815 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-27 14:01:54,815 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-27 14:01:54,815 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-27 14:01:54,815 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:01:54,815 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:01:54,815 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:01:54,816 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-27 14:01:54,816 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:01:54,817 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemState/6b6aa83da7871fbdb6b55637ee1962a9/cf, FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemState/6b6aa83da7871fbdb6b55637ee1962a9/recovered.edits] 2023-09-27 14:01:54,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-27 14:01:54,817 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemState/9c0c725282ff38d1b9034a4fbf711206/cf, FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemState/9c0c725282ff38d1b9034a4fbf711206/recovered.edits] 2023-09-27 14:01:54,821 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemState/9c0c725282ff38d1b9034a4fbf711206/cf/694ee5eb73d9427f94d9a6b68c619691 to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/archive/data/default/testtb-testExportFileSystemState/9c0c725282ff38d1b9034a4fbf711206/cf/694ee5eb73d9427f94d9a6b68c619691 2023-09-27 14:01:54,821 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemState/6b6aa83da7871fbdb6b55637ee1962a9/cf/03e61d59dcc6439bab50c623e3298b75 to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/archive/data/default/testtb-testExportFileSystemState/6b6aa83da7871fbdb6b55637ee1962a9/cf/03e61d59dcc6439bab50c623e3298b75 2023-09-27 14:01:54,825 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemState/9c0c725282ff38d1b9034a4fbf711206/recovered.edits/9.seqid to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/archive/data/default/testtb-testExportFileSystemState/9c0c725282ff38d1b9034a4fbf711206/recovered.edits/9.seqid 2023-09-27 14:01:54,825 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemState/6b6aa83da7871fbdb6b55637ee1962a9/recovered.edits/9.seqid to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/archive/data/default/testtb-testExportFileSystemState/6b6aa83da7871fbdb6b55637ee1962a9/recovered.edits/9.seqid 2023-09-27 14:01:54,826 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemState/9c0c725282ff38d1b9034a4fbf711206 2023-09-27 14:01:54,826 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemState/6b6aa83da7871fbdb6b55637ee1962a9 2023-09-27 14:01:54,826 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-27 14:01:54,826 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-27 14:01:54,827 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-09-27 14:01:54,831 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230927c38c846df22345d0a6f5d8ebb923aa1e to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230927c38c846df22345d0a6f5d8ebb923aa1e 2023-09-27 14:01:54,832 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230927c37529a5951346db88af5f0c290e479c to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230927c37529a5951346db88af5f0c290e479c 2023-09-27 14:01:54,833 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-27 14:01:54,835 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-27 14:01:54,838 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-09-27 14:01:54,840 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-09-27 14:01:54,842 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-27 14:01:54,842 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-09-27 14:01:54,842 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1695823299001.6b6aa83da7871fbdb6b55637ee1962a9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695823314842"}]},"ts":"9223372036854775807"} 2023-09-27 14:01:54,842 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1695823299001.9c0c725282ff38d1b9034a4fbf711206.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695823314842"}]},"ts":"9223372036854775807"} 2023-09-27 14:01:54,844 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-27 14:01:54,844 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6b6aa83da7871fbdb6b55637ee1962a9, NAME => 'testtb-testExportFileSystemState,,1695823299001.6b6aa83da7871fbdb6b55637ee1962a9.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 9c0c725282ff38d1b9034a4fbf711206, NAME => 'testtb-testExportFileSystemState,1,1695823299001.9c0c725282ff38d1b9034a4fbf711206.', STARTKEY => '1', ENDKEY => ''}] 2023-09-27 14:01:54,845 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-09-27 14:01:54,845 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695823314845"}]},"ts":"9223372036854775807"} 2023-09-27 14:01:54,849 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-09-27 14:01:54,851 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-27 14:01:54,853 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 47 msec 2023-09-27 14:01:54,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-27 14:01:54,918 INFO [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-09-27 14:01:54,928 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportFileSystemState" 2023-09-27 14:01:54,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-09-27 14:01:54,933 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemState" 2023-09-27 14:01:54,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-09-27 14:01:54,969 INFO [Listener at jenkins-hbase9.apache.org/33737] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=768 (was 754) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_292051434_1 at /127.0.0.1:41100 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5ef90b03-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5ef90b03-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1724413351_17 at /127.0.0.1:41118 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5ef90b03-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1724413351_17 at /127.0.0.1:51762 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1724413351_17 at /127.0.0.1:35886 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2107514926) connection to jenkins-hbase9.apache.org/172.31.2.10:41187 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Thread-2079 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_292051434_1 at /127.0.0.1:51718 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5ef90b03-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=926 (was 927), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=206 (was 227), ProcessCount=168 (was 168), AvailableMemoryMB=8954 (was 8933) - AvailableMemoryMB LEAK? - 2023-09-27 14:01:54,970 WARN [Listener at jenkins-hbase9.apache.org/33737] hbase.ResourceChecker(130): Thread=768 is superior to 500 2023-09-27 14:01:54,996 INFO [Listener at jenkins-hbase9.apache.org/33737] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=768, OpenFileDescriptor=926, MaxFileDescriptor=60000, SystemLoadAverage=206, ProcessCount=168, AvailableMemoryMB=8951 2023-09-27 14:01:54,996 WARN [Listener at jenkins-hbase9.apache.org/33737] hbase.ResourceChecker(130): Thread=768 is superior to 500 2023-09-27 14:01:54,998 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-27 14:01:55,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-09-27 14:01:55,004 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-09-27 14:01:55,004 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-09-27 14:01:55,005 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-27 14:01:55,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-27 14:01:55,009 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testConsecutiveExports/0bf7d69e367de5be79bc27cba67045c3 2023-09-27 14:01:55,009 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testConsecutiveExports/0dc65ca8dd60969c4c5dbeb31a6fb08e 2023-09-27 14:01:55,009 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testConsecutiveExports/0bf7d69e367de5be79bc27cba67045c3 empty. 2023-09-27 14:01:55,010 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testConsecutiveExports/0dc65ca8dd60969c4c5dbeb31a6fb08e empty. 2023-09-27 14:01:55,010 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testConsecutiveExports/0dc65ca8dd60969c4c5dbeb31a6fb08e 2023-09-27 14:01:55,010 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testConsecutiveExports/0bf7d69e367de5be79bc27cba67045c3 2023-09-27 14:01:55,010 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-27 14:01:55,027 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-09-27 14:01:55,028 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0bf7d69e367de5be79bc27cba67045c3, NAME => 'testtb-testConsecutiveExports,,1695823314998.0bf7d69e367de5be79bc27cba67045c3.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp 2023-09-27 14:01:55,028 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0dc65ca8dd60969c4c5dbeb31a6fb08e, NAME => 'testtb-testConsecutiveExports,1,1695823314998.0dc65ca8dd60969c4c5dbeb31a6fb08e.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp 2023-09-27 14:01:55,056 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695823314998.0bf7d69e367de5be79bc27cba67045c3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 14:01:55,056 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695823314998.0dc65ca8dd60969c4c5dbeb31a6fb08e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 14:01:55,057 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 0bf7d69e367de5be79bc27cba67045c3, disabling compactions & flushes 2023-09-27 14:01:55,057 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 0dc65ca8dd60969c4c5dbeb31a6fb08e, disabling compactions & flushes 2023-09-27 14:01:55,057 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695823314998.0bf7d69e367de5be79bc27cba67045c3. 2023-09-27 14:01:55,057 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695823314998.0dc65ca8dd60969c4c5dbeb31a6fb08e. 2023-09-27 14:01:55,057 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695823314998.0bf7d69e367de5be79bc27cba67045c3. 2023-09-27 14:01:55,057 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695823314998.0dc65ca8dd60969c4c5dbeb31a6fb08e. 2023-09-27 14:01:55,057 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695823314998.0bf7d69e367de5be79bc27cba67045c3. after waiting 0 ms 2023-09-27 14:01:55,057 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695823314998.0bf7d69e367de5be79bc27cba67045c3. 2023-09-27 14:01:55,057 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695823314998.0dc65ca8dd60969c4c5dbeb31a6fb08e. after waiting 0 ms 2023-09-27 14:01:55,057 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695823314998.0dc65ca8dd60969c4c5dbeb31a6fb08e. 2023-09-27 14:01:55,057 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695823314998.0bf7d69e367de5be79bc27cba67045c3. 2023-09-27 14:01:55,057 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695823314998.0dc65ca8dd60969c4c5dbeb31a6fb08e. 2023-09-27 14:01:55,057 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 0dc65ca8dd60969c4c5dbeb31a6fb08e: 2023-09-27 14:01:55,057 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 0bf7d69e367de5be79bc27cba67045c3: 2023-09-27 14:01:55,060 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-09-27 14:01:55,062 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695823314998.0dc65ca8dd60969c4c5dbeb31a6fb08e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695823315061"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695823315061"}]},"ts":"1695823315061"} 2023-09-27 14:01:55,062 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695823314998.0bf7d69e367de5be79bc27cba67045c3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695823315061"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695823315061"}]},"ts":"1695823315061"} 2023-09-27 14:01:55,064 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-27 14:01:55,065 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-27 14:01:55,065 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695823315065"}]},"ts":"1695823315065"} 2023-09-27 14:01:55,067 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-09-27 14:01:55,071 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-09-27 14:01:55,072 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 14:01:55,072 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 14:01:55,072 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 14:01:55,072 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 14:01:55,073 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0bf7d69e367de5be79bc27cba67045c3, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0dc65ca8dd60969c4c5dbeb31a6fb08e, ASSIGN}] 2023-09-27 14:01:55,076 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0dc65ca8dd60969c4c5dbeb31a6fb08e, ASSIGN 2023-09-27 14:01:55,076 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0bf7d69e367de5be79bc27cba67045c3, ASSIGN 2023-09-27 14:01:55,076 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0dc65ca8dd60969c4c5dbeb31a6fb08e, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,43797,1695823272608; forceNewPlan=false, retain=false 2023-09-27 14:01:55,077 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0bf7d69e367de5be79bc27cba67045c3, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,44379,1695823272702; forceNewPlan=false, retain=false 2023-09-27 14:01:55,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-27 14:01:55,227 INFO [jenkins-hbase9:32789] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-27 14:01:55,230 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=0bf7d69e367de5be79bc27cba67045c3, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:55,230 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=0dc65ca8dd60969c4c5dbeb31a6fb08e, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:55,230 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695823314998.0bf7d69e367de5be79bc27cba67045c3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695823315230"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695823315230"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695823315230"}]},"ts":"1695823315230"} 2023-09-27 14:01:55,230 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695823314998.0dc65ca8dd60969c4c5dbeb31a6fb08e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695823315230"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695823315230"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695823315230"}]},"ts":"1695823315230"} 2023-09-27 14:01:55,232 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 0bf7d69e367de5be79bc27cba67045c3, server=jenkins-hbase9.apache.org,44379,1695823272702}] 2023-09-27 14:01:55,233 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 0dc65ca8dd60969c4c5dbeb31a6fb08e, server=jenkins-hbase9.apache.org,43797,1695823272608}] 2023-09-27 14:01:55,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-27 14:01:55,390 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1695823314998.0dc65ca8dd60969c4c5dbeb31a6fb08e. 2023-09-27 14:01:55,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0dc65ca8dd60969c4c5dbeb31a6fb08e, NAME => 'testtb-testConsecutiveExports,1,1695823314998.0dc65ca8dd60969c4c5dbeb31a6fb08e.', STARTKEY => '1', ENDKEY => ''} 2023-09-27 14:01:55,391 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1695823314998.0bf7d69e367de5be79bc27cba67045c3. 2023-09-27 14:01:55,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0bf7d69e367de5be79bc27cba67045c3, NAME => 'testtb-testConsecutiveExports,,1695823314998.0bf7d69e367de5be79bc27cba67045c3.', STARTKEY => '', ENDKEY => '1'} 2023-09-27 14:01:55,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1695823314998.0dc65ca8dd60969c4c5dbeb31a6fb08e. service=AccessControlService 2023-09-27 14:01:55,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1695823314998.0bf7d69e367de5be79bc27cba67045c3. service=AccessControlService 2023-09-27 14:01:55,391 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 14:01:55,391 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 14:01:55,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 0bf7d69e367de5be79bc27cba67045c3 2023-09-27 14:01:55,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 0dc65ca8dd60969c4c5dbeb31a6fb08e 2023-09-27 14:01:55,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695823314998.0bf7d69e367de5be79bc27cba67045c3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 14:01:55,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695823314998.0dc65ca8dd60969c4c5dbeb31a6fb08e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 14:01:55,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 0bf7d69e367de5be79bc27cba67045c3 2023-09-27 14:01:55,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 0dc65ca8dd60969c4c5dbeb31a6fb08e 2023-09-27 14:01:55,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 0bf7d69e367de5be79bc27cba67045c3 2023-09-27 14:01:55,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 0dc65ca8dd60969c4c5dbeb31a6fb08e 2023-09-27 14:01:55,393 INFO [StoreOpener-0bf7d69e367de5be79bc27cba67045c3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0bf7d69e367de5be79bc27cba67045c3 2023-09-27 14:01:55,393 INFO [StoreOpener-0dc65ca8dd60969c4c5dbeb31a6fb08e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0dc65ca8dd60969c4c5dbeb31a6fb08e 2023-09-27 14:01:55,394 DEBUG [StoreOpener-0bf7d69e367de5be79bc27cba67045c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testConsecutiveExports/0bf7d69e367de5be79bc27cba67045c3/cf 2023-09-27 14:01:55,395 DEBUG [StoreOpener-0dc65ca8dd60969c4c5dbeb31a6fb08e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testConsecutiveExports/0dc65ca8dd60969c4c5dbeb31a6fb08e/cf 2023-09-27 14:01:55,395 DEBUG [StoreOpener-0dc65ca8dd60969c4c5dbeb31a6fb08e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testConsecutiveExports/0dc65ca8dd60969c4c5dbeb31a6fb08e/cf 2023-09-27 14:01:55,395 DEBUG [StoreOpener-0bf7d69e367de5be79bc27cba67045c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testConsecutiveExports/0bf7d69e367de5be79bc27cba67045c3/cf 2023-09-27 14:01:55,395 INFO [StoreOpener-0bf7d69e367de5be79bc27cba67045c3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0bf7d69e367de5be79bc27cba67045c3 columnFamilyName cf 2023-09-27 14:01:55,395 INFO [StoreOpener-0dc65ca8dd60969c4c5dbeb31a6fb08e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0dc65ca8dd60969c4c5dbeb31a6fb08e columnFamilyName cf 2023-09-27 14:01:55,397 INFO [StoreOpener-0bf7d69e367de5be79bc27cba67045c3-1] regionserver.HStore(310): Store=0bf7d69e367de5be79bc27cba67045c3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 14:01:55,397 INFO [StoreOpener-0dc65ca8dd60969c4c5dbeb31a6fb08e-1] regionserver.HStore(310): Store=0dc65ca8dd60969c4c5dbeb31a6fb08e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 14:01:55,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testConsecutiveExports/0bf7d69e367de5be79bc27cba67045c3 2023-09-27 14:01:55,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testConsecutiveExports/0dc65ca8dd60969c4c5dbeb31a6fb08e 2023-09-27 14:01:55,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testConsecutiveExports/0bf7d69e367de5be79bc27cba67045c3 2023-09-27 14:01:55,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testConsecutiveExports/0dc65ca8dd60969c4c5dbeb31a6fb08e 2023-09-27 14:01:55,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 0bf7d69e367de5be79bc27cba67045c3 2023-09-27 14:01:55,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 0dc65ca8dd60969c4c5dbeb31a6fb08e 2023-09-27 14:01:55,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testConsecutiveExports/0bf7d69e367de5be79bc27cba67045c3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 14:01:55,403 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 0bf7d69e367de5be79bc27cba67045c3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68120048, jitterRate=0.015067815780639648}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 14:01:55,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testConsecutiveExports/0dc65ca8dd60969c4c5dbeb31a6fb08e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 14:01:55,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 0bf7d69e367de5be79bc27cba67045c3: 2023-09-27 14:01:55,404 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 0dc65ca8dd60969c4c5dbeb31a6fb08e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72338323, jitterRate=0.07792501151561737}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 14:01:55,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 0dc65ca8dd60969c4c5dbeb31a6fb08e: 2023-09-27 14:01:55,404 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1695823314998.0bf7d69e367de5be79bc27cba67045c3., pid=45, masterSystemTime=1695823315384 2023-09-27 14:01:55,405 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1695823314998.0dc65ca8dd60969c4c5dbeb31a6fb08e., pid=46, masterSystemTime=1695823315384 2023-09-27 14:01:55,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1695823314998.0bf7d69e367de5be79bc27cba67045c3. 2023-09-27 14:01:55,406 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1695823314998.0bf7d69e367de5be79bc27cba67045c3. 2023-09-27 14:01:55,406 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=0bf7d69e367de5be79bc27cba67045c3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:55,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1695823314998.0dc65ca8dd60969c4c5dbeb31a6fb08e. 2023-09-27 14:01:55,407 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1695823314998.0bf7d69e367de5be79bc27cba67045c3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695823315406"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695823315406"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695823315406"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695823315406"}]},"ts":"1695823315406"} 2023-09-27 14:01:55,407 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1695823314998.0dc65ca8dd60969c4c5dbeb31a6fb08e. 2023-09-27 14:01:55,407 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=0dc65ca8dd60969c4c5dbeb31a6fb08e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:55,407 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1695823314998.0dc65ca8dd60969c4c5dbeb31a6fb08e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695823315407"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695823315407"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695823315407"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695823315407"}]},"ts":"1695823315407"} 2023-09-27 14:01:55,411 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=43 2023-09-27 14:01:55,411 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 0bf7d69e367de5be79bc27cba67045c3, server=jenkins-hbase9.apache.org,44379,1695823272702 in 176 msec 2023-09-27 14:01:55,412 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=44 2023-09-27 14:01:55,412 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 0dc65ca8dd60969c4c5dbeb31a6fb08e, server=jenkins-hbase9.apache.org,43797,1695823272608 in 176 msec 2023-09-27 14:01:55,414 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0bf7d69e367de5be79bc27cba67045c3, ASSIGN in 338 msec 2023-09-27 14:01:55,416 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=42 2023-09-27 14:01:55,416 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0dc65ca8dd60969c4c5dbeb31a6fb08e, ASSIGN in 339 msec 2023-09-27 14:01:55,416 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-27 14:01:55,417 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695823315417"}]},"ts":"1695823315417"} 2023-09-27 14:01:55,418 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-09-27 14:01:55,421 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-09-27 14:01:55,421 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-09-27 14:01:55,423 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44379] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-27 14:01:55,424 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:01:55,424 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:01:55,424 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:01:55,424 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:01:55,427 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-27 14:01:55,427 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-27 14:01:55,427 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-27 14:01:55,427 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-27 14:01:55,428 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 429 msec 2023-09-27 14:01:55,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-27 14:01:55,610 INFO [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-09-27 14:01:55,613 DEBUG [Listener at jenkins-hbase9.apache.org/33737] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-27 14:01:55,613 DEBUG [Listener at jenkins-hbase9.apache.org/33737] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695823314998.0bf7d69e367de5be79bc27cba67045c3. 2023-09-27 14:01:55,615 INFO [Listener at jenkins-hbase9.apache.org/33737] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 14:01:55,628 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-27 14:01:55,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695823315628 (current time:1695823315628). 2023-09-27 14:01:55,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 14:01:55,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(139): Connect 0x7ba0f045 to 127.0.0.1:60071 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 14:01:55,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d2ee6f8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 14:01:55,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 14:01:55,643 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58108, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 14:01:55,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7ba0f045 to 127.0.0.1:60071 2023-09-27 14:01:55,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 14:01:55,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(139): Connect 0x7cc8184e to 127.0.0.1:60071 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 14:01:55,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@16fd4a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 14:01:55,654 DEBUG [hconnection-0x5a55c296-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 14:01:55,657 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58124, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 14:01:55,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 14:01:55,663 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:34966, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 14:01:55,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7cc8184e to 127.0.0.1:60071 2023-09-27 14:01:55,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 14:01:55,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-27 14:01:55,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 14:01:55,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-27 14:01:55,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-27 14:01:55,669 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-27 14:01:55,670 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695823915670 2023-09-27 14:01:55,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-27 14:01:55,670 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-27 14:01:55,672 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 14:01:55,672 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 14:01:55,672 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-27 14:01:55,673 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-27 14:01:55,675 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-09-27 14:01:55,675 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-27 14:01:55,676 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695823915676 2023-09-27 14:01:55,686 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,686 INFO [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-09-27 14:01:55,687 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:01:55,688 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-09-27 14:01:55,688 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-27 14:01:55,689 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,689 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,690 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:01:55,690 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:01:55,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:01:55,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:01:55,690 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:01:55,690 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:55,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:01:55,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:01:55,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:01:55,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:01:55,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,690 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:55,691 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:55,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,691 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,691 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:55,691 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,691 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 14:01:55,691 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-27 14:01:55,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,691 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-27 14:01:55,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-27 14:01:55,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-27 14:01:55,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,692 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,692 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-27 14:01:55,692 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-27 14:01:55,692 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-27 14:01:55,692 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:01:55,693 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-27 14:01:55,693 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,693 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,693 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-27 14:01:55,693 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-27 14:01:55,693 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:01:55,693 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-27 14:01:55,694 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-27 14:01:55,695 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-27 14:01:55,693 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:01:55,695 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44379,1695823272702' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-27 14:01:55,698 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-27 14:01:55,698 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-27 14:01:55,694 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33659,1695823272661' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-27 14:01:55,698 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,43797,1695823272608' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-27 14:01:55,699 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:55,699 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,700 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,700 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:55,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:01:55,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:01:55,700 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:55,700 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,700 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 14:01:55,700 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,700 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 14:01:55,700 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,700 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 14:01:55,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:01:55,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:01:55,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:55,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:55,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:55,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:01:55,702 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44379,1695823272702' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-27 14:01:55,702 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@42f01367[Count = 1] remaining members to acquire global barrier 2023-09-27 14:01:55,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:55,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:01:55,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:01:55,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:01:55,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:01:55,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:55,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:55,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:55,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:01:55,704 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,43797,1695823272608' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-27 14:01:55,705 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@42f01367[Count = 0] remaining members to acquire global barrier 2023-09-27 14:01:55,705 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-27 14:01:55,705 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,706 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,706 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,706 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,706 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-27 14:01:55,706 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:55,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,706 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-27 14:01:55,706 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-27 14:01:55,706 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 14:01:55,707 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 14:01:55,706 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695823314998.0dc65ca8dd60969c4c5dbeb31a6fb08e. 2023-09-27 14:01:55,706 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-27 14:01:55,707 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695823314998.0bf7d69e367de5be79bc27cba67045c3. 2023-09-27 14:01:55,707 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695823314998.0dc65ca8dd60969c4c5dbeb31a6fb08e. started... 2023-09-27 14:01:55,706 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:55,707 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 14:01:55,707 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695823314998.0bf7d69e367de5be79bc27cba67045c3. started... 2023-09-27 14:01:55,707 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,33659,1695823272661' in zk 2023-09-27 14:01:55,707 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 14:01:55,707 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 14:01:55,708 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0bf7d69e367de5be79bc27cba67045c3: 2023-09-27 14:01:55,708 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0dc65ca8dd60969c4c5dbeb31a6fb08e: 2023-09-27 14:01:55,709 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695823314998.0bf7d69e367de5be79bc27cba67045c3.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,709 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695823314998.0dc65ca8dd60969c4c5dbeb31a6fb08e.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,709 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 14:01:55,710 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 14:01:55,710 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 14:01:55,710 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 14:01:55,718 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-27 14:01:55,718 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:01:55,718 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-27 14:01:55,727 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695823314998.0dc65ca8dd60969c4c5dbeb31a6fb08e. completed. 2023-09-27 14:01:55,727 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695823314998.0dc65ca8dd60969c4c5dbeb31a6fb08e. 2023-09-27 14:01:55,727 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 14:01:55,727 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 14:01:55,727 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695823314998.0bf7d69e367de5be79bc27cba67045c3. completed. 2023-09-27 14:01:55,727 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:55,727 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695823314998.0bf7d69e367de5be79bc27cba67045c3. 2023-09-27 14:01:55,727 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-27 14:01:55,727 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,43797,1695823272608' in zk 2023-09-27 14:01:55,727 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 14:01:55,727 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 14:01:55,727 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:55,728 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-27 14:01:55,728 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,44379,1695823272702' in zk 2023-09-27 14:01:55,729 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-27 14:01:55,729 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:55,729 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:01:55,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:55,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:01:55,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:01:55,729 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-27 14:01:55,731 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:55,731 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-27 14:01:55,731 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:01:55,731 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-27 14:01:55,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:01:55,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:01:55,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:55,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:55,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:55,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:01:55,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:55,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:55,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:55,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,43797,1695823272608': 2023-09-27 14:01:55,736 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,43797,1695823272608' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-27 14:01:55,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:55,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:01:55,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:01:55,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:01:55,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:01:55,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:55,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:55,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:55,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:01:55,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:55,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:55,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:55,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,44379,1695823272702': 2023-09-27 14:01:55,739 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44379,1695823272702' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-27 14:01:55,739 INFO [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-09-27 14:01:55,739 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 14:01:55,739 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 14:01:55,739 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,739 INFO [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 14:01:55,741 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,741 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,741 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:01:55,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,741 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:01:55,741 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,741 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:01:55,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:01:55,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,742 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:55,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:01:55,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:01:55,742 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:01:55,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:01:55,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:01:55,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:01:55,742 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:55,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:01:55,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:01:55,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,743 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:55,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:01:55,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:55,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:55,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:55,745 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:55,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:01:55,745 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:55,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,747 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:55,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:55,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:55,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:55,751 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:55,752 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:01:55,752 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:01:55,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:01:55,752 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:01:55,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:01:55,752 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:01:55,752 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:01:55,752 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-27 14:01:55,752 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:01:55,752 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,752 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:01:55,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:01:55,752 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:01:55,752 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 14:01:55,752 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:55,752 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:01:55,752 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:55,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:01:55,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:01:55,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:01:55,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:01:55,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:01:55,753 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,754 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:55,754 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,754 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:55,754 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:55,754 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,754 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,754 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-27 14:01:55,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:01:55,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:01:55,769 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,769 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,772 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 14:01:55,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-27 14:01:55,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-27 14:01:55,773 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 14:01:55,788 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,788 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-27 14:01:55,788 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,789 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-27 14:01:55,789 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695823315671Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695823315769 (+98 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1695823315769Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1695823315769Writing data manifest for emptySnaptb0-testConsecutiveExports at 1695823315772 (+3 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1695823315781 (+9 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695823315788 (+7 ms) 2023-09-27 14:01:55,791 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-27 14:01:55,793 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 120 msec 2023-09-27 14:01:55,973 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 14:01:55,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-27 14:01:55,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 14:01:55,977 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44379] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1695823314998.0bf7d69e367de5be79bc27cba67045c3. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 14:01:55,979 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43797] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1695823314998.0dc65ca8dd60969c4c5dbeb31a6fb08e. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 14:01:55,982 DEBUG [Listener at jenkins-hbase9.apache.org/33737] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-27 14:01:55,982 DEBUG [Listener at jenkins-hbase9.apache.org/33737] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695823314998.0bf7d69e367de5be79bc27cba67045c3. 2023-09-27 14:01:55,982 INFO [Listener at jenkins-hbase9.apache.org/33737] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 14:01:55,994 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-27 14:01:55,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695823315994 (current time:1695823315994). 2023-09-27 14:01:55,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 14:01:55,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(139): Connect 0x41d4bcd5 to 127.0.0.1:60071 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 14:01:56,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@50c710a9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 14:01:56,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 14:01:56,010 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58140, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 14:01:56,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x41d4bcd5 to 127.0.0.1:60071 2023-09-27 14:01:56,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 14:01:56,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(139): Connect 0x0d1be0d8 to 127.0.0.1:60071 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 14:01:56,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@694dc7ba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 14:01:56,021 DEBUG [hconnection-0x167d062-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 14:01:56,024 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58144, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 14:01:56,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 14:01:56,030 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:34968, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 14:01:56,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0d1be0d8 to 127.0.0.1:60071 2023-09-27 14:01:56,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 14:01:56,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-27 14:01:56,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 14:01:56,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-27 14:01:56,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-27 14:01:56,036 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-27 14:01:56,037 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695823916037 2023-09-27 14:01:56,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-27 14:01:56,037 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-27 14:01:56,039 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 14:01:56,039 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 14:01:56,042 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-27 14:01:56,043 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-27 14:01:56,044 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 9 msec 2023-09-27 14:01:56,045 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-27 14:01:56,046 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695823916046 2023-09-27 14:01:56,064 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-09-27 14:01:56,064 INFO [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-09-27 14:01:56,064 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:01:56,065 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-09-27 14:01:56,065 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-27 14:01:56,066 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,066 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,067 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:56,067 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:01:56,067 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:01:56,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:01:56,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:01:56,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:01:56,067 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:01:56,068 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:56,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:01:56,068 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:56,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:01:56,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:01:56,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,068 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:56,068 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 14:01:56,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,068 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,069 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,069 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-27 14:01:56,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,069 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-27 14:01:56,070 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-27 14:01:56,070 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-27 14:01:56,070 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:01:56,071 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-27 14:01:56,071 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-27 14:01:56,071 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33659,1695823272661' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-27 14:01:56,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-27 14:01:56,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,072 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-27 14:01:56,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-27 14:01:56,072 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-27 14:01:56,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,072 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-27 14:01:56,072 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:01:56,072 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-27 14:01:56,074 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-27 14:01:56,074 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-27 14:01:56,074 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44379,1695823272702' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-27 14:01:56,074 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-27 14:01:56,074 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-27 14:01:56,074 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:01:56,075 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-27 14:01:56,075 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-27 14:01:56,075 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,43797,1695823272608' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-27 14:01:56,076 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,077 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:56,077 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,078 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:56,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:56,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:01:56,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:01:56,077 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,078 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 14:01:56,078 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,078 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 14:01:56,077 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:01:56,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:01:56,078 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,078 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 14:01:56,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-27 14:01:56,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:56,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:56,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:56,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:01:56,080 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,43797,1695823272608' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-27 14:01:56,080 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3148e82[Count = 1] remaining members to acquire global barrier 2023-09-27 14:01:56,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:56,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:01:56,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:01:56,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:01:56,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:01:56,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-27 14:01:56,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:56,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:56,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:56,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:01:56,083 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44379,1695823272702' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-27 14:01:56,083 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3148e82[Count = 0] remaining members to acquire global barrier 2023-09-27 14:01:56,083 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-27 14:01:56,083 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,085 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,085 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,085 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,085 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-27 14:01:56,085 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-27 14:01:56,085 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:56,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,085 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-27 14:01:56,085 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 14:01:56,085 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 14:01:56,085 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-27 14:01:56,085 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,33659,1695823272661' in zk 2023-09-27 14:01:56,086 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:56,086 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 14:01:56,086 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 14:01:56,086 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 14:01:56,086 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695823314998.0bf7d69e367de5be79bc27cba67045c3. 2023-09-27 14:01:56,086 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695823314998.0dc65ca8dd60969c4c5dbeb31a6fb08e. 2023-09-27 14:01:56,086 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695823314998.0bf7d69e367de5be79bc27cba67045c3. started... 2023-09-27 14:01:56,086 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695823314998.0dc65ca8dd60969c4c5dbeb31a6fb08e. started... 2023-09-27 14:01:56,086 INFO [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0bf7d69e367de5be79bc27cba67045c3 1/1 column families, dataSize=333 B heapSize=976 B 2023-09-27 14:01:56,086 INFO [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0dc65ca8dd60969c4c5dbeb31a6fb08e 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-09-27 14:01:56,088 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-27 14:01:56,088 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:01:56,088 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-27 14:01:56,125 INFO [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230927a1611950b3c14645866adbb84343abe7 to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230927a1611950b3c14645866adbb84343abe7 2023-09-27 14:01:56,126 INFO [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230927118d6b7e98f143379484b8d28a939a2a to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230927118d6b7e98f143379484b8d28a939a2a 2023-09-27 14:01:56,136 INFO [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testConsecutiveExports/0bf7d69e367de5be79bc27cba67045c3/.tmp/cf/2da419de452b497fbe002824c6017c04 2023-09-27 14:01:56,137 INFO [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testConsecutiveExports/0dc65ca8dd60969c4c5dbeb31a6fb08e/.tmp/cf/6607732b6bc74e958b9edc13de3db24f 2023-09-27 14:01:56,139 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 14:01:56,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-27 14:01:56,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-27 14:01:56,140 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 14:01:56,142 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testConsecutiveExports/0bf7d69e367de5be79bc27cba67045c3/.tmp/cf/2da419de452b497fbe002824c6017c04 as hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testConsecutiveExports/0bf7d69e367de5be79bc27cba67045c3/cf/2da419de452b497fbe002824c6017c04 2023-09-27 14:01:56,142 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testConsecutiveExports/0dc65ca8dd60969c4c5dbeb31a6fb08e/.tmp/cf/6607732b6bc74e958b9edc13de3db24f as hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testConsecutiveExports/0dc65ca8dd60969c4c5dbeb31a6fb08e/cf/6607732b6bc74e958b9edc13de3db24f 2023-09-27 14:01:56,147 INFO [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testConsecutiveExports/0dc65ca8dd60969c4c5dbeb31a6fb08e/cf/6607732b6bc74e958b9edc13de3db24f, entries=45, sequenceid=6, filesize=12.4 K 2023-09-27 14:01:56,147 INFO [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testConsecutiveExports/0bf7d69e367de5be79bc27cba67045c3/cf/2da419de452b497fbe002824c6017c04, entries=5, sequenceid=6, filesize=5.7 K 2023-09-27 14:01:56,149 INFO [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 0bf7d69e367de5be79bc27cba67045c3 in 63ms, sequenceid=6, compaction requested=false 2023-09-27 14:01:56,149 INFO [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 0dc65ca8dd60969c4c5dbeb31a6fb08e in 63ms, sequenceid=6, compaction requested=false 2023-09-27 14:01:56,149 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-27 14:01:56,149 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-27 14:01:56,151 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0bf7d69e367de5be79bc27cba67045c3: 2023-09-27 14:01:56,151 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0dc65ca8dd60969c4c5dbeb31a6fb08e: 2023-09-27 14:01:56,151 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695823314998.0bf7d69e367de5be79bc27cba67045c3.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-27 14:01:56,151 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695823314998.0dc65ca8dd60969c4c5dbeb31a6fb08e.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-27 14:01:56,151 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 14:01:56,151 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 14:01:56,151 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testConsecutiveExports/0bf7d69e367de5be79bc27cba67045c3/cf/2da419de452b497fbe002824c6017c04] hfiles 2023-09-27 14:01:56,151 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testConsecutiveExports/0dc65ca8dd60969c4c5dbeb31a6fb08e/cf/6607732b6bc74e958b9edc13de3db24f] hfiles 2023-09-27 14:01:56,152 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testConsecutiveExports/0dc65ca8dd60969c4c5dbeb31a6fb08e/cf/6607732b6bc74e958b9edc13de3db24f for snapshot=snaptb0-testConsecutiveExports 2023-09-27 14:01:56,152 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testConsecutiveExports/0bf7d69e367de5be79bc27cba67045c3/cf/2da419de452b497fbe002824c6017c04 for snapshot=snaptb0-testConsecutiveExports 2023-09-27 14:01:56,161 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695823314998.0bf7d69e367de5be79bc27cba67045c3. completed. 2023-09-27 14:01:56,161 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695823314998.0dc65ca8dd60969c4c5dbeb31a6fb08e. completed. 2023-09-27 14:01:56,161 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695823314998.0dc65ca8dd60969c4c5dbeb31a6fb08e. 2023-09-27 14:01:56,161 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695823314998.0bf7d69e367de5be79bc27cba67045c3. 2023-09-27 14:01:56,161 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 14:01:56,161 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 14:01:56,161 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:56,161 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 14:01:56,161 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 14:01:56,161 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-27 14:01:56,161 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:56,161 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,43797,1695823272608' in zk 2023-09-27 14:01:56,162 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-27 14:01:56,162 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,44379,1695823272702' in zk 2023-09-27 14:01:56,164 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-27 14:01:56,164 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-27 14:01:56,164 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:56,164 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:01:56,164 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:56,164 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:01:56,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:56,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:01:56,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:01:56,164 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-27 14:01:56,165 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-27 14:01:56,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:01:56,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:01:56,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-27 14:01:56,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:56,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:56,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:56,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:01:56,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-27 14:01:56,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:56,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:56,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:56,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,44379,1695823272702': 2023-09-27 14:01:56,170 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44379,1695823272702' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-27 14:01:56,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:56,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:01:56,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:01:56,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:01:56,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:01:56,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-27 14:01:56,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:56,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:56,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:56,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:01:56,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-27 14:01:56,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:56,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:56,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:56,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,43797,1695823272608': 2023-09-27 14:01:56,174 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,43797,1695823272608' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-27 14:01:56,174 INFO [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-09-27 14:01:56,174 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 14:01:56,174 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 14:01:56,174 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-09-27 14:01:56,174 INFO [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 14:01:56,176 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,176 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,176 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,176 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:01:56,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:01:56,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,176 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:01:56,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,176 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:01:56,176 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:01:56,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:01:56,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:01:56,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:01:56,176 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:56,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:01:56,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:01:56,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:01:56,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:01:56,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-27 14:01:56,177 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:56,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:01:56,177 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:56,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-27 14:01:56,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:56,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:56,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:56,179 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:56,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:01:56,179 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:56,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-27 14:01:56,179 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:56,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:56,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:56,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:56,186 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:01:56,186 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:01:56,186 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:56,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:01:56,187 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:01:56,187 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:01:56,187 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:01:56,186 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:01:56,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:01:56,186 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:01:56,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:01:56,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:01:56,189 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:01:56,187 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-09-27 14:01:56,187 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:56,189 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-27 14:01:56,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:01:56,189 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:56,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:01:56,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:01:56,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:01:56,189 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,189 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-27 14:01:56,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:01:56,189 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 14:01:56,189 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:01:56,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:01:56,190 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:01:56,190 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:01:56,190 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:01:56,190 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,190 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,190 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230927118d6b7e98f143379484b8d28a939a2a, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230927a1611950b3c14645866adbb84343abe7] mob files 2023-09-27 14:01:56,191 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230927118d6b7e98f143379484b8d28a939a2a 2023-09-27 14:01:56,191 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230927a1611950b3c14645866adbb84343abe7 2023-09-27 14:01:56,201 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-09-27 14:01:56,202 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,221 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,222 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-27 14:01:56,222 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,222 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,223 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695823316037Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695823316201 (+164 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1695823316201Loading Region manifests for snaptb0-testConsecutiveExports at 1695823316201Writing data manifest for snaptb0-testConsecutiveExports at 1695823316206 (+5 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1695823316214 (+8 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695823316222 (+8 ms) 2023-09-27 14:01:56,225 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-27 14:01:56,227 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 187 msec 2023-09-27 14:01:56,341 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 14:01:56,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-27 14:01:56,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 14:01:56,342 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/local-export-1695823316342 2023-09-27 14:01:56,343 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/local-export-1695823316342, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/local-export-1695823316342, srcFsUri=hdfs://localhost:46363, srcDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30 2023-09-27 14:01:56,366 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:46363, inputRoot=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30 2023-09-27 14:01:56,366 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@5a45a278, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/local-export-1695823316342, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/local-export-1695823316342/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,366 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:46363, inputRoot=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30, snapshotDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-27 14:01:56,375 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/local-export-1695823316342/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-27 14:01:56,388 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-27 14:01:56,388 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-27 14:01:56,389 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-27 14:01:56,389 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-27 14:01:57,286 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/hadoop-4938285955638195483.jar 2023-09-27 14:01:57,286 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-27 14:01:57,286 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-27 14:01:57,353 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/hadoop-1239254390876859161.jar 2023-09-27 14:01:57,353 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-27 14:01:57,353 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-27 14:01:57,354 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-27 14:01:57,354 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-27 14:01:57,355 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-27 14:01:57,355 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-27 14:01:57,355 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-27 14:01:57,356 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-27 14:01:57,356 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-27 14:01:57,356 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-27 14:01:57,357 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-27 14:01:57,357 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-27 14:01:57,358 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-27 14:01:57,358 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-27 14:01:57,358 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-27 14:01:57,359 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-27 14:01:57,359 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 14:01:57,360 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 14:01:57,360 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 14:01:57,360 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 14:01:57,361 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 14:01:57,361 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 14:01:57,362 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 14:01:58,152 WARN [Listener at jenkins-hbase9.apache.org/33737] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-27 14:01:58,154 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-27 14:01:58,156 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-27 14:01:58,943 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 14:01:58,943 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 14:01:58,946 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695823279135_0002_000001 (auth:SIMPLE) 2023-09-27 14:01:59,718 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695823279135_0003_000001 (auth:SIMPLE) 2023-09-27 14:02:00,265 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-27 14:02:03,662 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695823279135_0003_000001 (auth:SIMPLE) 2023-09-27 14:02:05,886 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695823279135_0003_000001 (auth:SIMPLE) 2023-09-27 14:02:08,409 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695823279135_0003_000001 (auth:SIMPLE) 2023-09-27 14:02:10,331 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-27 14:02:10,331 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-27 14:02:10,336 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-27 14:02:10,336 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-27 14:02:10,337 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-27 14:02:10,337 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1724413351_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-27 14:02:10,340 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(367): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-27 14:02:10,340 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(367): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-27 14:02:10,340 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@32d51fe5 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/local-export-1695823316342/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/local-export-1695823316342/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-27 14:02:10,340 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/local-export-1695823316342/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-27 14:02:10,340 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/local-export-1695823316342/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-27 14:02:10,341 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/local-export-1695823316342, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/local-export-1695823316342, srcFsUri=hdfs://localhost:46363, srcDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30 2023-09-27 14:02:10,364 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:46363, inputRoot=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30 2023-09-27 14:02:10,364 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@20bffa0f, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/local-export-1695823316342, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/local-export-1695823316342/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-27 14:02:10,364 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:46363, inputRoot=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30, snapshotDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-27 14:02:10,381 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/local-export-1695823316342/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-27 14:02:10,393 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-27 14:02:10,394 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-27 14:02:10,394 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-27 14:02:10,394 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-27 14:02:11,264 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/hadoop-8046512946465051080.jar 2023-09-27 14:02:11,265 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-27 14:02:11,265 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-27 14:02:11,331 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/hadoop-4358379930818424149.jar 2023-09-27 14:02:11,332 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-27 14:02:11,332 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-27 14:02:11,333 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-27 14:02:11,333 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-27 14:02:11,334 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-27 14:02:11,334 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-27 14:02:11,334 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-27 14:02:11,335 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-27 14:02:11,335 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-27 14:02:11,336 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-27 14:02:11,336 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-27 14:02:11,336 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-27 14:02:11,337 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-27 14:02:11,337 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-27 14:02:11,337 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-27 14:02:11,338 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-27 14:02:11,338 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 14:02:11,339 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 14:02:11,339 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 14:02:11,340 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 14:02:11,340 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 14:02:11,340 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 14:02:11,341 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 14:02:11,748 WARN [Listener at jenkins-hbase9.apache.org/33737] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-27 14:02:11,750 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-27 14:02:11,752 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-27 14:02:14,586 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 14:02:14,586 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 14:02:14,589 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695823279135_0003_000001 (auth:SIMPLE) 2023-09-27 14:02:14,956 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695823279135_0004_000001 (auth:SIMPLE) 2023-09-27 14:02:18,760 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695823279135_0004_000001 (auth:SIMPLE) 2023-09-27 14:02:20,985 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695823279135_0004_000001 (auth:SIMPLE) 2023-09-27 14:02:23,242 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695823279135_0004_000001 (auth:SIMPLE) 2023-09-27 14:02:24,973 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-27 14:02:24,974 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-27 14:02:24,977 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-27 14:02:24,977 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-27 14:02:24,977 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-27 14:02:24,977 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1724413351_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-27 14:02:24,980 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(367): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-27 14:02:24,980 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(367): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-27 14:02:24,980 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@32d51fe5 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/local-export-1695823316342/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/local-export-1695823316342/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-27 14:02:24,980 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/local-export-1695823316342/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-27 14:02:24,980 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/local-export-1695823316342/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-27 14:02:24,993 INFO [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-09-27 14:02:24,994 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testConsecutiveExports 2023-09-27 14:02:24,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-09-27 14:02:24,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-27 14:02:24,999 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695823344998"}]},"ts":"1695823344998"} 2023-09-27 14:02:25,000 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-09-27 14:02:25,002 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-09-27 14:02:25,002 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0bf7d69e367de5be79bc27cba67045c3, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0dc65ca8dd60969c4c5dbeb31a6fb08e, UNASSIGN}] 2023-09-27 14:02:25,005 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0dc65ca8dd60969c4c5dbeb31a6fb08e, UNASSIGN 2023-09-27 14:02:25,005 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0bf7d69e367de5be79bc27cba67045c3, UNASSIGN 2023-09-27 14:02:25,006 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=0dc65ca8dd60969c4c5dbeb31a6fb08e, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:25,006 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=0bf7d69e367de5be79bc27cba67045c3, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:25,006 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695823314998.0dc65ca8dd60969c4c5dbeb31a6fb08e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695823345006"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695823345006"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695823345006"}]},"ts":"1695823345006"} 2023-09-27 14:02:25,006 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695823314998.0bf7d69e367de5be79bc27cba67045c3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695823345006"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695823345006"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695823345006"}]},"ts":"1695823345006"} 2023-09-27 14:02:25,007 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 0dc65ca8dd60969c4c5dbeb31a6fb08e, server=jenkins-hbase9.apache.org,43797,1695823272608}] 2023-09-27 14:02:25,008 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 0bf7d69e367de5be79bc27cba67045c3, server=jenkins-hbase9.apache.org,44379,1695823272702}] 2023-09-27 14:02:25,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-27 14:02:25,160 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 0dc65ca8dd60969c4c5dbeb31a6fb08e 2023-09-27 14:02:25,160 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 0dc65ca8dd60969c4c5dbeb31a6fb08e, disabling compactions & flushes 2023-09-27 14:02:25,160 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695823314998.0dc65ca8dd60969c4c5dbeb31a6fb08e. 2023-09-27 14:02:25,160 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695823314998.0dc65ca8dd60969c4c5dbeb31a6fb08e. 2023-09-27 14:02:25,160 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695823314998.0dc65ca8dd60969c4c5dbeb31a6fb08e. after waiting 0 ms 2023-09-27 14:02:25,160 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695823314998.0dc65ca8dd60969c4c5dbeb31a6fb08e. 2023-09-27 14:02:25,161 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 0bf7d69e367de5be79bc27cba67045c3 2023-09-27 14:02:25,162 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 0bf7d69e367de5be79bc27cba67045c3, disabling compactions & flushes 2023-09-27 14:02:25,164 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695823314998.0bf7d69e367de5be79bc27cba67045c3. 2023-09-27 14:02:25,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695823314998.0bf7d69e367de5be79bc27cba67045c3. 2023-09-27 14:02:25,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695823314998.0bf7d69e367de5be79bc27cba67045c3. after waiting 0 ms 2023-09-27 14:02:25,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695823314998.0bf7d69e367de5be79bc27cba67045c3. 2023-09-27 14:02:25,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testConsecutiveExports/0dc65ca8dd60969c4c5dbeb31a6fb08e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 14:02:25,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testConsecutiveExports/0bf7d69e367de5be79bc27cba67045c3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 14:02:25,174 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 14:02:25,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 14:02:25,175 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695823314998.0dc65ca8dd60969c4c5dbeb31a6fb08e. 2023-09-27 14:02:25,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 0dc65ca8dd60969c4c5dbeb31a6fb08e: 2023-09-27 14:02:25,176 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695823314998.0bf7d69e367de5be79bc27cba67045c3. 2023-09-27 14:02:25,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 0bf7d69e367de5be79bc27cba67045c3: 2023-09-27 14:02:25,177 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 0dc65ca8dd60969c4c5dbeb31a6fb08e 2023-09-27 14:02:25,178 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=0dc65ca8dd60969c4c5dbeb31a6fb08e, regionState=CLOSED 2023-09-27 14:02:25,178 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695823314998.0dc65ca8dd60969c4c5dbeb31a6fb08e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695823345178"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695823345178"}]},"ts":"1695823345178"} 2023-09-27 14:02:25,178 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 0bf7d69e367de5be79bc27cba67045c3 2023-09-27 14:02:25,179 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=0bf7d69e367de5be79bc27cba67045c3, regionState=CLOSED 2023-09-27 14:02:25,179 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695823314998.0bf7d69e367de5be79bc27cba67045c3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695823345179"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695823345179"}]},"ts":"1695823345179"} 2023-09-27 14:02:25,181 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=53 2023-09-27 14:02:25,181 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 0dc65ca8dd60969c4c5dbeb31a6fb08e, server=jenkins-hbase9.apache.org,43797,1695823272608 in 172 msec 2023-09-27 14:02:25,182 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=52 2023-09-27 14:02:25,182 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 0bf7d69e367de5be79bc27cba67045c3, server=jenkins-hbase9.apache.org,44379,1695823272702 in 172 msec 2023-09-27 14:02:25,183 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0dc65ca8dd60969c4c5dbeb31a6fb08e, UNASSIGN in 179 msec 2023-09-27 14:02:25,184 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-09-27 14:02:25,184 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0bf7d69e367de5be79bc27cba67045c3, UNASSIGN in 180 msec 2023-09-27 14:02:25,185 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695823345185"}]},"ts":"1695823345185"} 2023-09-27 14:02:25,186 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-09-27 14:02:25,188 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-09-27 14:02:25,190 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 195 msec 2023-09-27 14:02:25,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-27 14:02:25,301 INFO [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-09-27 14:02:25,302 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testConsecutiveExports 2023-09-27 14:02:25,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-27 14:02:25,305 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-27 14:02:25,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-09-27 14:02:25,306 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-27 14:02:25,310 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44379] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-09-27 14:02:25,313 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-27 14:02:25,313 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-27 14:02:25,313 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-27 14:02:25,313 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-27 14:02:25,313 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testConsecutiveExports/0bf7d69e367de5be79bc27cba67045c3 2023-09-27 14:02:25,313 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testConsecutiveExports/0dc65ca8dd60969c4c5dbeb31a6fb08e 2023-09-27 14:02:25,314 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-27 14:02:25,314 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-27 14:02:25,314 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-27 14:02:25,314 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-27 14:02:25,315 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-27 14:02:25,315 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-27 14:02:25,315 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-27 14:02:25,315 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:02:25,315 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:02:25,315 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-27 14:02:25,315 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:02:25,315 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:02:25,316 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testConsecutiveExports/0dc65ca8dd60969c4c5dbeb31a6fb08e/cf, FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testConsecutiveExports/0dc65ca8dd60969c4c5dbeb31a6fb08e/recovered.edits] 2023-09-27 14:02:25,316 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testConsecutiveExports/0bf7d69e367de5be79bc27cba67045c3/cf, FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testConsecutiveExports/0bf7d69e367de5be79bc27cba67045c3/recovered.edits] 2023-09-27 14:02:25,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-27 14:02:25,321 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testConsecutiveExports/0bf7d69e367de5be79bc27cba67045c3/cf/2da419de452b497fbe002824c6017c04 to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/archive/data/default/testtb-testConsecutiveExports/0bf7d69e367de5be79bc27cba67045c3/cf/2da419de452b497fbe002824c6017c04 2023-09-27 14:02:25,321 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testConsecutiveExports/0dc65ca8dd60969c4c5dbeb31a6fb08e/cf/6607732b6bc74e958b9edc13de3db24f to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/archive/data/default/testtb-testConsecutiveExports/0dc65ca8dd60969c4c5dbeb31a6fb08e/cf/6607732b6bc74e958b9edc13de3db24f 2023-09-27 14:02:25,324 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testConsecutiveExports/0bf7d69e367de5be79bc27cba67045c3/recovered.edits/9.seqid to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/archive/data/default/testtb-testConsecutiveExports/0bf7d69e367de5be79bc27cba67045c3/recovered.edits/9.seqid 2023-09-27 14:02:25,324 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testConsecutiveExports/0dc65ca8dd60969c4c5dbeb31a6fb08e/recovered.edits/9.seqid to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/archive/data/default/testtb-testConsecutiveExports/0dc65ca8dd60969c4c5dbeb31a6fb08e/recovered.edits/9.seqid 2023-09-27 14:02:25,325 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testConsecutiveExports/0bf7d69e367de5be79bc27cba67045c3 2023-09-27 14:02:25,325 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testConsecutiveExports/0dc65ca8dd60969c4c5dbeb31a6fb08e 2023-09-27 14:02:25,325 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-27 14:02:25,325 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-27 14:02:25,326 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-09-27 14:02:25,329 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230927118d6b7e98f143379484b8d28a939a2a to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230927118d6b7e98f143379484b8d28a939a2a 2023-09-27 14:02:25,331 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230927a1611950b3c14645866adbb84343abe7 to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230927a1611950b3c14645866adbb84343abe7 2023-09-27 14:02:25,331 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-27 14:02:25,333 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-27 14:02:25,336 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-09-27 14:02:25,338 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-09-27 14:02:25,339 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-27 14:02:25,339 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-09-27 14:02:25,339 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1695823314998.0bf7d69e367de5be79bc27cba67045c3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695823345339"}]},"ts":"9223372036854775807"} 2023-09-27 14:02:25,340 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1695823314998.0dc65ca8dd60969c4c5dbeb31a6fb08e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695823345339"}]},"ts":"9223372036854775807"} 2023-09-27 14:02:25,341 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-27 14:02:25,341 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0bf7d69e367de5be79bc27cba67045c3, NAME => 'testtb-testConsecutiveExports,,1695823314998.0bf7d69e367de5be79bc27cba67045c3.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 0dc65ca8dd60969c4c5dbeb31a6fb08e, NAME => 'testtb-testConsecutiveExports,1,1695823314998.0dc65ca8dd60969c4c5dbeb31a6fb08e.', STARTKEY => '1', ENDKEY => ''}] 2023-09-27 14:02:25,342 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-09-27 14:02:25,342 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695823345342"}]},"ts":"9223372036854775807"} 2023-09-27 14:02:25,343 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-09-27 14:02:25,347 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-27 14:02:25,348 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 45 msec 2023-09-27 14:02:25,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-27 14:02:25,418 INFO [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-09-27 14:02:25,428 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testConsecutiveExports" 2023-09-27 14:02:25,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-09-27 14:02:25,432 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testConsecutiveExports" 2023-09-27 14:02:25,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-09-27 14:02:25,459 INFO [Listener at jenkins-hbase9.apache.org/33737] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=747 (was 768), OpenFileDescriptor=905 (was 926), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=162 (was 206), ProcessCount=168 (was 168), AvailableMemoryMB=8736 (was 8951) 2023-09-27 14:02:25,459 WARN [Listener at jenkins-hbase9.apache.org/33737] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-09-27 14:02:25,479 INFO [Listener at jenkins-hbase9.apache.org/33737] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=747, OpenFileDescriptor=905, MaxFileDescriptor=60000, SystemLoadAverage=162, ProcessCount=168, AvailableMemoryMB=8735 2023-09-27 14:02:25,479 WARN [Listener at jenkins-hbase9.apache.org/33737] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-09-27 14:02:25,481 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-27 14:02:25,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:25,485 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-09-27 14:02:25,485 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-09-27 14:02:25,486 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-27 14:02:25,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-27 14:02:25,489 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b9534e5f3a0b031775fb6842af05749 2023-09-27 14:02:25,489 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/93b1e42539f4b8b79573a0e13c781e61 2023-09-27 14:02:25,489 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b9534e5f3a0b031775fb6842af05749 empty. 2023-09-27 14:02:25,489 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/93b1e42539f4b8b79573a0e13c781e61 empty. 2023-09-27 14:02:25,490 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/93b1e42539f4b8b79573a0e13c781e61 2023-09-27 14:02:25,490 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b9534e5f3a0b031775fb6842af05749 2023-09-27 14:02:25,490 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-27 14:02:25,513 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-09-27 14:02:25,514 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9b9534e5f3a0b031775fb6842af05749, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695823345481.9b9534e5f3a0b031775fb6842af05749.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp 2023-09-27 14:02:25,515 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 93b1e42539f4b8b79573a0e13c781e61, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695823345481.93b1e42539f4b8b79573a0e13c781e61.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp 2023-09-27 14:02:25,535 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695823345481.9b9534e5f3a0b031775fb6842af05749.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 14:02:25,535 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 9b9534e5f3a0b031775fb6842af05749, disabling compactions & flushes 2023-09-27 14:02:25,535 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695823345481.9b9534e5f3a0b031775fb6842af05749. 2023-09-27 14:02:25,535 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695823345481.9b9534e5f3a0b031775fb6842af05749. 2023-09-27 14:02:25,535 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695823345481.93b1e42539f4b8b79573a0e13c781e61.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 14:02:25,535 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695823345481.9b9534e5f3a0b031775fb6842af05749. after waiting 0 ms 2023-09-27 14:02:25,536 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 93b1e42539f4b8b79573a0e13c781e61, disabling compactions & flushes 2023-09-27 14:02:25,536 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695823345481.9b9534e5f3a0b031775fb6842af05749. 2023-09-27 14:02:25,536 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695823345481.9b9534e5f3a0b031775fb6842af05749. 2023-09-27 14:02:25,536 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695823345481.93b1e42539f4b8b79573a0e13c781e61. 2023-09-27 14:02:25,536 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 9b9534e5f3a0b031775fb6842af05749: 2023-09-27 14:02:25,536 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695823345481.93b1e42539f4b8b79573a0e13c781e61. 2023-09-27 14:02:25,536 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695823345481.93b1e42539f4b8b79573a0e13c781e61. after waiting 0 ms 2023-09-27 14:02:25,536 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695823345481.93b1e42539f4b8b79573a0e13c781e61. 2023-09-27 14:02:25,536 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695823345481.93b1e42539f4b8b79573a0e13c781e61. 2023-09-27 14:02:25,536 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 93b1e42539f4b8b79573a0e13c781e61: 2023-09-27 14:02:25,539 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-09-27 14:02:25,540 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695823345481.9b9534e5f3a0b031775fb6842af05749.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695823345539"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695823345539"}]},"ts":"1695823345539"} 2023-09-27 14:02:25,540 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695823345481.93b1e42539f4b8b79573a0e13c781e61.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695823345539"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695823345539"}]},"ts":"1695823345539"} 2023-09-27 14:02:25,546 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-27 14:02:25,547 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-27 14:02:25,547 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695823345547"}]},"ts":"1695823345547"} 2023-09-27 14:02:25,548 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-09-27 14:02:25,551 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-09-27 14:02:25,553 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 14:02:25,553 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 14:02:25,553 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 14:02:25,553 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 14:02:25,553 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9b9534e5f3a0b031775fb6842af05749, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=93b1e42539f4b8b79573a0e13c781e61, ASSIGN}] 2023-09-27 14:02:25,556 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=93b1e42539f4b8b79573a0e13c781e61, ASSIGN 2023-09-27 14:02:25,556 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9b9534e5f3a0b031775fb6842af05749, ASSIGN 2023-09-27 14:02:25,557 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=93b1e42539f4b8b79573a0e13c781e61, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,44379,1695823272702; forceNewPlan=false, retain=false 2023-09-27 14:02:25,557 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9b9534e5f3a0b031775fb6842af05749, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,43797,1695823272608; forceNewPlan=false, retain=false 2023-09-27 14:02:25,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-27 14:02:25,707 INFO [jenkins-hbase9:32789] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-27 14:02:25,710 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=93b1e42539f4b8b79573a0e13c781e61, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:25,710 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=9b9534e5f3a0b031775fb6842af05749, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:25,710 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695823345481.9b9534e5f3a0b031775fb6842af05749.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695823345710"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695823345710"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695823345710"}]},"ts":"1695823345710"} 2023-09-27 14:02:25,710 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695823345481.93b1e42539f4b8b79573a0e13c781e61.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695823345710"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695823345710"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695823345710"}]},"ts":"1695823345710"} 2023-09-27 14:02:25,712 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 93b1e42539f4b8b79573a0e13c781e61, server=jenkins-hbase9.apache.org,44379,1695823272702}] 2023-09-27 14:02:25,713 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 9b9534e5f3a0b031775fb6842af05749, server=jenkins-hbase9.apache.org,43797,1695823272608}] 2023-09-27 14:02:25,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-27 14:02:25,867 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1695823345481.93b1e42539f4b8b79573a0e13c781e61. 2023-09-27 14:02:25,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 93b1e42539f4b8b79573a0e13c781e61, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695823345481.93b1e42539f4b8b79573a0e13c781e61.', STARTKEY => '1', ENDKEY => ''} 2023-09-27 14:02:25,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1695823345481.93b1e42539f4b8b79573a0e13c781e61. service=AccessControlService 2023-09-27 14:02:25,868 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 14:02:25,868 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1695823345481.9b9534e5f3a0b031775fb6842af05749. 2023-09-27 14:02:25,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 93b1e42539f4b8b79573a0e13c781e61 2023-09-27 14:02:25,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9b9534e5f3a0b031775fb6842af05749, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695823345481.9b9534e5f3a0b031775fb6842af05749.', STARTKEY => '', ENDKEY => '1'} 2023-09-27 14:02:25,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695823345481.93b1e42539f4b8b79573a0e13c781e61.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 14:02:25,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 93b1e42539f4b8b79573a0e13c781e61 2023-09-27 14:02:25,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 93b1e42539f4b8b79573a0e13c781e61 2023-09-27 14:02:25,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1695823345481.9b9534e5f3a0b031775fb6842af05749. service=AccessControlService 2023-09-27 14:02:25,869 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 14:02:25,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 9b9534e5f3a0b031775fb6842af05749 2023-09-27 14:02:25,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695823345481.9b9534e5f3a0b031775fb6842af05749.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 14:02:25,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 9b9534e5f3a0b031775fb6842af05749 2023-09-27 14:02:25,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 9b9534e5f3a0b031775fb6842af05749 2023-09-27 14:02:25,870 INFO [StoreOpener-93b1e42539f4b8b79573a0e13c781e61-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 93b1e42539f4b8b79573a0e13c781e61 2023-09-27 14:02:25,870 INFO [StoreOpener-9b9534e5f3a0b031775fb6842af05749-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9b9534e5f3a0b031775fb6842af05749 2023-09-27 14:02:25,872 DEBUG [StoreOpener-93b1e42539f4b8b79573a0e13c781e61-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion/93b1e42539f4b8b79573a0e13c781e61/cf 2023-09-27 14:02:25,872 DEBUG [StoreOpener-9b9534e5f3a0b031775fb6842af05749-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b9534e5f3a0b031775fb6842af05749/cf 2023-09-27 14:02:25,872 DEBUG [StoreOpener-93b1e42539f4b8b79573a0e13c781e61-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion/93b1e42539f4b8b79573a0e13c781e61/cf 2023-09-27 14:02:25,872 DEBUG [StoreOpener-9b9534e5f3a0b031775fb6842af05749-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b9534e5f3a0b031775fb6842af05749/cf 2023-09-27 14:02:25,873 INFO [StoreOpener-9b9534e5f3a0b031775fb6842af05749-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9b9534e5f3a0b031775fb6842af05749 columnFamilyName cf 2023-09-27 14:02:25,873 INFO [StoreOpener-93b1e42539f4b8b79573a0e13c781e61-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 93b1e42539f4b8b79573a0e13c781e61 columnFamilyName cf 2023-09-27 14:02:25,874 INFO [StoreOpener-9b9534e5f3a0b031775fb6842af05749-1] regionserver.HStore(310): Store=9b9534e5f3a0b031775fb6842af05749/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 14:02:25,874 INFO [StoreOpener-93b1e42539f4b8b79573a0e13c781e61-1] regionserver.HStore(310): Store=93b1e42539f4b8b79573a0e13c781e61/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 14:02:25,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b9534e5f3a0b031775fb6842af05749 2023-09-27 14:02:25,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion/93b1e42539f4b8b79573a0e13c781e61 2023-09-27 14:02:25,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b9534e5f3a0b031775fb6842af05749 2023-09-27 14:02:25,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion/93b1e42539f4b8b79573a0e13c781e61 2023-09-27 14:02:25,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 93b1e42539f4b8b79573a0e13c781e61 2023-09-27 14:02:25,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 9b9534e5f3a0b031775fb6842af05749 2023-09-27 14:02:25,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion/93b1e42539f4b8b79573a0e13c781e61/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 14:02:25,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b9534e5f3a0b031775fb6842af05749/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 14:02:25,881 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 93b1e42539f4b8b79573a0e13c781e61; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69906724, jitterRate=0.041691362857818604}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 14:02:25,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 93b1e42539f4b8b79573a0e13c781e61: 2023-09-27 14:02:25,881 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 9b9534e5f3a0b031775fb6842af05749; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60910104, jitterRate=-0.0923687219619751}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 14:02:25,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 9b9534e5f3a0b031775fb6842af05749: 2023-09-27 14:02:25,882 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1695823345481.93b1e42539f4b8b79573a0e13c781e61., pid=60, masterSystemTime=1695823345864 2023-09-27 14:02:25,882 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1695823345481.9b9534e5f3a0b031775fb6842af05749., pid=61, masterSystemTime=1695823345865 2023-09-27 14:02:25,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1695823345481.93b1e42539f4b8b79573a0e13c781e61. 2023-09-27 14:02:25,884 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1695823345481.93b1e42539f4b8b79573a0e13c781e61. 2023-09-27 14:02:25,885 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=93b1e42539f4b8b79573a0e13c781e61, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:25,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1695823345481.9b9534e5f3a0b031775fb6842af05749. 2023-09-27 14:02:25,885 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1695823345481.9b9534e5f3a0b031775fb6842af05749. 2023-09-27 14:02:25,885 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695823345481.93b1e42539f4b8b79573a0e13c781e61.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695823345885"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695823345885"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695823345885"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695823345885"}]},"ts":"1695823345885"} 2023-09-27 14:02:25,885 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=9b9534e5f3a0b031775fb6842af05749, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:25,886 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695823345481.9b9534e5f3a0b031775fb6842af05749.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695823345885"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695823345885"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695823345885"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695823345885"}]},"ts":"1695823345885"} 2023-09-27 14:02:25,889 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-09-27 14:02:25,889 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 93b1e42539f4b8b79573a0e13c781e61, server=jenkins-hbase9.apache.org,44379,1695823272702 in 175 msec 2023-09-27 14:02:25,890 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=58 2023-09-27 14:02:25,890 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 9b9534e5f3a0b031775fb6842af05749, server=jenkins-hbase9.apache.org,43797,1695823272608 in 175 msec 2023-09-27 14:02:25,892 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=93b1e42539f4b8b79573a0e13c781e61, ASSIGN in 336 msec 2023-09-27 14:02:25,893 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=58, resume processing ppid=57 2023-09-27 14:02:25,893 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9b9534e5f3a0b031775fb6842af05749, ASSIGN in 337 msec 2023-09-27 14:02:25,893 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-27 14:02:25,894 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695823345893"}]},"ts":"1695823345893"} 2023-09-27 14:02:25,895 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-09-27 14:02:25,897 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-09-27 14:02:25,897 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-09-27 14:02:25,899 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44379] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-27 14:02:25,902 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:02:25,902 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:02:25,902 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:02:25,902 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:02:25,904 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 14:02:25,904 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 14:02:25,904 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 14:02:25,904 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 14:02:25,905 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 423 msec 2023-09-27 14:02:26,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-27 14:02:26,090 INFO [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-09-27 14:02:26,093 DEBUG [Listener at jenkins-hbase9.apache.org/33737] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,093 DEBUG [Listener at jenkins-hbase9.apache.org/33737] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695823345481.9b9534e5f3a0b031775fb6842af05749. 2023-09-27 14:02:26,096 INFO [Listener at jenkins-hbase9.apache.org/33737] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 14:02:26,111 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-27 14:02:26,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695823346111 (current time:1695823346111). 2023-09-27 14:02:26,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 14:02:26,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(139): Connect 0x5740fadd to 127.0.0.1:60071 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 14:02:26,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2fec044, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 14:02:26,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 14:02:26,122 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:51306, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 14:02:26,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5740fadd to 127.0.0.1:60071 2023-09-27 14:02:26,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 14:02:26,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(139): Connect 0x5aadb39c to 127.0.0.1:60071 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 14:02:26,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a6b3c06, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 14:02:26,132 DEBUG [hconnection-0x7e6321ef-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 14:02:26,133 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:51322, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 14:02:26,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 14:02:26,141 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:41986, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 14:02:26,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5aadb39c to 127.0.0.1:60071 2023-09-27 14:02:26,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 14:02:26,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-27 14:02:26,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 14:02:26,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-27 14:02:26,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-27 14:02:26,146 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-27 14:02:26,147 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695823946147 2023-09-27 14:02:26,147 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-27 14:02:26,149 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 14:02:26,149 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 14:02:26,149 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-27 14:02:26,150 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-27 14:02:26,152 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 7 msec 2023-09-27 14:02:26,153 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-27 14:02:26,153 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695823946153 2023-09-27 14:02:26,165 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,166 INFO [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-27 14:02:26,166 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:02:26,167 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-27 14:02:26,167 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-27 14:02:26,168 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,168 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,169 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:26,169 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:02:26,169 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:02:26,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:02:26,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:02:26,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:02:26,169 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:02:26,170 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:26,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:02:26,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:02:26,170 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:26,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:02:26,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,170 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:26,170 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 14:02:26,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,170 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,170 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,171 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-27 14:02:26,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-27 14:02:26,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-27 14:02:26,171 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-27 14:02:26,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,171 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,171 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-27 14:02:26,172 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:02:26,171 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-27 14:02:26,173 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-27 14:02:26,173 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-27 14:02:26,172 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-27 14:02:26,173 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44379,1695823272702' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-27 14:02:26,173 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,173 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-27 14:02:26,173 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:02:26,175 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,175 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:26,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:26,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:02:26,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:02:26,175 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,175 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 14:02:26,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:02:26,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:02:26,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:26,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:02:26,177 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44379,1695823272702' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-27 14:02:26,177 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7215be27[Count = 1] remaining members to acquire global barrier 2023-09-27 14:02:26,181 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-27 14:02:26,181 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-27 14:02:26,181 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,181 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,43797,1695823272608' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-27 14:02:26,182 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-27 14:02:26,182 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:02:26,183 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-27 14:02:26,183 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-27 14:02:26,183 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33659,1695823272661' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-27 14:02:26,186 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,186 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:26,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:26,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:02:26,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:02:26,186 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,186 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,187 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 14:02:26,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:02:26,187 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,187 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 14:02:26,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:02:26,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:26,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:26,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:26,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:02:26,189 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,43797,1695823272608' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-27 14:02:26,189 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7215be27[Count = 0] remaining members to acquire global barrier 2023-09-27 14:02:26,189 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-27 14:02:26,189 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,191 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,191 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,191 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,192 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-27 14:02:26,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,192 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:26,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,192 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-27 14:02:26,192 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 14:02:26,192 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 14:02:26,192 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695823345481.9b9534e5f3a0b031775fb6842af05749. 2023-09-27 14:02:26,192 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:26,192 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695823345481.9b9534e5f3a0b031775fb6842af05749. started... 2023-09-27 14:02:26,192 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-27 14:02:26,192 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 14:02:26,192 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-27 14:02:26,192 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9b9534e5f3a0b031775fb6842af05749: 2023-09-27 14:02:26,192 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,33659,1695823272661' in zk 2023-09-27 14:02:26,192 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 14:02:26,192 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 14:02:26,192 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695823345481.93b1e42539f4b8b79573a0e13c781e61. 2023-09-27 14:02:26,193 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695823345481.9b9534e5f3a0b031775fb6842af05749.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,193 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695823345481.93b1e42539f4b8b79573a0e13c781e61. started... 2023-09-27 14:02:26,193 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 14:02:26,193 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 14:02:26,194 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 93b1e42539f4b8b79573a0e13c781e61: 2023-09-27 14:02:26,194 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695823345481.93b1e42539f4b8b79573a0e13c781e61.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,194 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 14:02:26,195 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 14:02:26,198 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-27 14:02:26,199 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:02:26,199 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-27 14:02:26,224 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695823345481.93b1e42539f4b8b79573a0e13c781e61. completed. 2023-09-27 14:02:26,224 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695823345481.9b9534e5f3a0b031775fb6842af05749. completed. 2023-09-27 14:02:26,225 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695823345481.9b9534e5f3a0b031775fb6842af05749. 2023-09-27 14:02:26,224 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695823345481.93b1e42539f4b8b79573a0e13c781e61. 2023-09-27 14:02:26,225 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 14:02:26,225 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 14:02:26,225 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 14:02:26,225 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 14:02:26,225 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:26,225 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:26,225 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-27 14:02:26,225 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-27 14:02:26,225 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,44379,1695823272702' in zk 2023-09-27 14:02:26,225 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,43797,1695823272608' in zk 2023-09-27 14:02:26,228 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:26,228 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-27 14:02:26,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:26,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:02:26,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:02:26,228 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:02:26,228 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:26,228 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-27 14:02:26,228 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-27 14:02:26,229 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:02:26,229 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-27 14:02:26,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:02:26,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:02:26,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:26,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:26,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:26,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:02:26,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:26,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:26,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:26,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,44379,1695823272702': 2023-09-27 14:02:26,233 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44379,1695823272702' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-27 14:02:26,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:26,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:02:26,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:02:26,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:02:26,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:02:26,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:26,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:26,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:26,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:02:26,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:26,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:26,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:26,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,43797,1695823272608': 2023-09-27 14:02:26,237 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,43797,1695823272608' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-27 14:02:26,237 INFO [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-27 14:02:26,237 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 14:02:26,237 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 14:02:26,237 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,237 INFO [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 14:02:26,239 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,239 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:02:26,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,239 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,239 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,239 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:02:26,239 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:02:26,239 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:02:26,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:02:26,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:02:26,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:02:26,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,240 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:26,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:02:26,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:02:26,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:02:26,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:02:26,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:02:26,240 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:26,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,241 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:26,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:02:26,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:26,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:26,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:26,243 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:26,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:02:26,243 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:26,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,243 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:26,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:26,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:26,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:26,248 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:02:26,248 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:02:26,248 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:02:26,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:02:26,248 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:02:26,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:02:26,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:02:26,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:02:26,248 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:02:26,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:02:26,249 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:26,248 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:02:26,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:02:26,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:02:26,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:02:26,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:02:26,249 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 14:02:26,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:02:26,249 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,249 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,250 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,249 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:02:26,250 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,250 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:26,250 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 14:02:26,252 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:26,252 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,252 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:26,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:02:26,252 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:02:26,252 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:26,252 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:26,252 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-27 14:02:26,252 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-27 14:02:26,252 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-27 14:02:26,252 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 14:02:26,264 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,264 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,286 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,287 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-27 14:02:26,287 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,288 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,288 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695823346147Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695823346263 (+116 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695823346263Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695823346264 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695823346267 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695823346281 (+14 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695823346287 (+6 ms) 2023-09-27 14:02:26,290 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-27 14:02:26,292 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 141 msec 2023-09-27 14:02:26,453 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 14:02:26,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-27 14:02:26,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 14:02:26,456 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43797] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1695823345481.9b9534e5f3a0b031775fb6842af05749. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 14:02:26,457 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44379] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1695823345481.93b1e42539f4b8b79573a0e13c781e61. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 14:02:26,460 DEBUG [Listener at jenkins-hbase9.apache.org/33737] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,460 DEBUG [Listener at jenkins-hbase9.apache.org/33737] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695823345481.9b9534e5f3a0b031775fb6842af05749. 2023-09-27 14:02:26,460 INFO [Listener at jenkins-hbase9.apache.org/33737] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 14:02:26,470 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-27 14:02:26,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695823346470 (current time:1695823346470). 2023-09-27 14:02:26,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 14:02:26,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(139): Connect 0x323da76d to 127.0.0.1:60071 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 14:02:26,474 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-27 14:02:26,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40fdb849, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 14:02:26,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 14:02:26,482 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:51332, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 14:02:26,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x323da76d to 127.0.0.1:60071 2023-09-27 14:02:26,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 14:02:26,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(139): Connect 0x570c6fed to 127.0.0.1:60071 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 14:02:26,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8d5acae, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 14:02:26,492 DEBUG [hconnection-0x25c7720d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 14:02:26,495 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:51344, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 14:02:26,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 14:02:26,501 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:42000, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 14:02:26,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x570c6fed to 127.0.0.1:60071 2023-09-27 14:02:26,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 14:02:26,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-27 14:02:26,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 14:02:26,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-27 14:02:26,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-27 14:02:26,506 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-27 14:02:26,507 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695823946507 2023-09-27 14:02:26,507 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-27 14:02:26,508 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 14:02:26,508 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 14:02:26,509 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-27 14:02:26,508 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-27 14:02:26,510 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-27 14:02:26,511 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-27 14:02:26,511 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695823946511 2023-09-27 14:02:26,520 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,520 INFO [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-27 14:02:26,520 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:02:26,522 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-27 14:02:26,522 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-27 14:02:26,522 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,522 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,524 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:02:26,524 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:02:26,524 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:26,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:02:26,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:02:26,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:02:26,524 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:02:26,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:02:26,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:02:26,524 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:26,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:02:26,524 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:26,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,524 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,525 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:26,525 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 14:02:26,525 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-27 14:02:26,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,525 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-27 14:02:26,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-27 14:02:26,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,525 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,525 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-27 14:02:26,525 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,525 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-27 14:02:26,525 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,525 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:02:26,526 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-27 14:02:26,527 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-27 14:02:26,527 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-27 14:02:26,527 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:02:26,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-27 14:02:26,528 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-27 14:02:26,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,527 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33659,1695823272661' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-27 14:02:26,528 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-27 14:02:26,528 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,43797,1695823272608' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-27 14:02:26,528 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-27 14:02:26,528 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,528 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-27 14:02:26,528 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:02:26,529 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-27 14:02:26,529 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-27 14:02:26,529 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44379,1695823272702' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-27 14:02:26,530 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:26,530 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:26,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:02:26,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:02:26,531 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:02:26,531 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,531 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 14:02:26,531 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,531 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 14:02:26,533 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:26,533 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:02:26,533 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,533 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 14:02:26,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:26,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:26,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:26,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:02:26,534 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,43797,1695823272608' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-27 14:02:26,535 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@518cbcd0[Count = 1] remaining members to acquire global barrier 2023-09-27 14:02:26,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:26,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:02:26,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:02:26,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:02:26,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:02:26,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:26,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:26,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:26,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:02:26,536 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44379,1695823272702' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-27 14:02:26,536 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@518cbcd0[Count = 0] remaining members to acquire global barrier 2023-09-27 14:02:26,536 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-27 14:02:26,536 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,538 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,538 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,538 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,538 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:26,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,538 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-27 14:02:26,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,538 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 14:02:26,538 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-27 14:02:26,538 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695823345481.9b9534e5f3a0b031775fb6842af05749. 2023-09-27 14:02:26,538 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-27 14:02:26,538 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 14:02:26,538 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 14:02:26,538 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695823345481.93b1e42539f4b8b79573a0e13c781e61. 2023-09-27 14:02:26,538 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695823345481.9b9534e5f3a0b031775fb6842af05749. started... 2023-09-27 14:02:26,539 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695823345481.93b1e42539f4b8b79573a0e13c781e61. started... 2023-09-27 14:02:26,538 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 14:02:26,538 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:26,539 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 14:02:26,538 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-27 14:02:26,539 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,33659,1695823272661' in zk 2023-09-27 14:02:26,539 INFO [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 93b1e42539f4b8b79573a0e13c781e61 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-09-27 14:02:26,539 INFO [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9b9534e5f3a0b031775fb6842af05749 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-09-27 14:02:26,541 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-27 14:02:26,541 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:02:26,541 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-27 14:02:26,557 INFO [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230927c36814b2f4a6489482ac5fafcb61ed78 to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230927c36814b2f4a6489482ac5fafcb61ed78 2023-09-27 14:02:26,557 INFO [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230927f55d84fb87a845c8a21e5f97c4ce9de8 to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230927f55d84fb87a845c8a21e5f97c4ce9de8 2023-09-27 14:02:26,565 INFO [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b9534e5f3a0b031775fb6842af05749/.tmp/cf/def07b897fec4b01b73819f1308f091f 2023-09-27 14:02:26,565 INFO [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion/93b1e42539f4b8b79573a0e13c781e61/.tmp/cf/eeff04a649dc435dbc8bdaababd76506 2023-09-27 14:02:26,570 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion/93b1e42539f4b8b79573a0e13c781e61/.tmp/cf/eeff04a649dc435dbc8bdaababd76506 as hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion/93b1e42539f4b8b79573a0e13c781e61/cf/eeff04a649dc435dbc8bdaababd76506 2023-09-27 14:02:26,570 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b9534e5f3a0b031775fb6842af05749/.tmp/cf/def07b897fec4b01b73819f1308f091f as hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b9534e5f3a0b031775fb6842af05749/cf/def07b897fec4b01b73819f1308f091f 2023-09-27 14:02:26,575 INFO [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion/93b1e42539f4b8b79573a0e13c781e61/cf/eeff04a649dc435dbc8bdaababd76506, entries=44, sequenceid=6, filesize=13.0 K 2023-09-27 14:02:26,575 INFO [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b9534e5f3a0b031775fb6842af05749/cf/def07b897fec4b01b73819f1308f091f, entries=6, sequenceid=6, filesize=6.0 K 2023-09-27 14:02:26,576 INFO [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 93b1e42539f4b8b79573a0e13c781e61 in 37ms, sequenceid=6, compaction requested=false 2023-09-27 14:02:26,577 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 93b1e42539f4b8b79573a0e13c781e61: 2023-09-27 14:02:26,577 INFO [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 9b9534e5f3a0b031775fb6842af05749 in 37ms, sequenceid=6, compaction requested=false 2023-09-27 14:02:26,578 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695823345481.93b1e42539f4b8b79573a0e13c781e61.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,578 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9b9534e5f3a0b031775fb6842af05749: 2023-09-27 14:02:26,578 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 14:02:26,578 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion/93b1e42539f4b8b79573a0e13c781e61/cf/eeff04a649dc435dbc8bdaababd76506] hfiles 2023-09-27 14:02:26,578 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion/93b1e42539f4b8b79573a0e13c781e61/cf/eeff04a649dc435dbc8bdaababd76506 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,578 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695823345481.9b9534e5f3a0b031775fb6842af05749.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,578 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 14:02:26,578 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b9534e5f3a0b031775fb6842af05749/cf/def07b897fec4b01b73819f1308f091f] hfiles 2023-09-27 14:02:26,578 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b9534e5f3a0b031775fb6842af05749/cf/def07b897fec4b01b73819f1308f091f for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,590 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695823345481.9b9534e5f3a0b031775fb6842af05749. completed. 2023-09-27 14:02:26,590 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695823345481.93b1e42539f4b8b79573a0e13c781e61. completed. 2023-09-27 14:02:26,590 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695823345481.93b1e42539f4b8b79573a0e13c781e61. 2023-09-27 14:02:26,590 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695823345481.9b9534e5f3a0b031775fb6842af05749. 2023-09-27 14:02:26,590 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 14:02:26,590 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 14:02:26,590 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 14:02:26,590 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 14:02:26,590 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:26,590 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:26,590 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-27 14:02:26,590 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-27 14:02:26,590 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,43797,1695823272608' in zk 2023-09-27 14:02:26,591 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,44379,1695823272702' in zk 2023-09-27 14:02:26,592 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-27 14:02:26,592 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:26,592 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-27 14:02:26,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:26,593 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:02:26,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:02:26,593 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-27 14:02:26,592 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:26,592 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:02:26,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:02:26,594 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-27 14:02:26,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:02:26,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:02:26,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:26,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:26,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:26,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:02:26,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:26,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:26,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:26,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,44379,1695823272702': 2023-09-27 14:02:26,598 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44379,1695823272702' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-27 14:02:26,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:26,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:02:26,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:02:26,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:02:26,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:02:26,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:26,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:26,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:26,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:02:26,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:26,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:26,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:26,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,43797,1695823272608': 2023-09-27 14:02:26,601 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,43797,1695823272608' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-27 14:02:26,601 INFO [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-27 14:02:26,601 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 14:02:26,601 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 14:02:26,601 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,601 INFO [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 14:02:26,606 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,606 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,606 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,606 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,607 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:02:26,607 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:02:26,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,607 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:26,606 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:02:26,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:02:26,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:02:26,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,607 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:26,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:02:26,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:02:26,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:02:26,608 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:26,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:02:26,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:02:26,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:02:26,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:02:26,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:02:26,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:26,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:26,609 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 14:02:26,609 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:26,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:26,610 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:26,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:02:26,610 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:26,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-27 14:02:26,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-27 14:02:26,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:26,610 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 14:02:26,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:26,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:26,613 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:26,613 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:02:26,613 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,613 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:02:26,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:02:26,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:02:26,613 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:02:26,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:02:26,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:02:26,613 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,613 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:02:26,613 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:02:26,613 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:26,613 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:02:26,614 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:26,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:02:26,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:02:26,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:02:26,615 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,614 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:02:26,616 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,614 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:02:26,616 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 14:02:26,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:02:26,616 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:26,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:02:26,616 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,616 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:26,616 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:26,616 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,616 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:02:26,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:02:26,617 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230927f55d84fb87a845c8a21e5f97c4ce9de8, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230927c36814b2f4a6489482ac5fafcb61ed78] mob files 2023-09-27 14:02:26,617 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230927f55d84fb87a845c8a21e5f97c4ce9de8 2023-09-27 14:02:26,617 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230927c36814b2f4a6489482ac5fafcb61ed78 2023-09-27 14:02:26,624 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,624 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,642 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,643 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-27 14:02:26,643 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,644 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:26,644 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695823346507Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695823346624 (+117 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695823346624Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1695823346624Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1695823346627 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695823346634 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695823346643 (+9 ms) 2023-09-27 14:02:26,646 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-27 14:02:26,648 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 138 msec 2023-09-27 14:02:26,811 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 14:02:26,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-27 14:02:26,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 14:02:26,840 DEBUG [Listener at jenkins-hbase9.apache.org/33737] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-27 14:02:26,843 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:49434, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-27 14:02:26,845 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33659] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-27 14:02:26,845 DEBUG [Listener at jenkins-hbase9.apache.org/33737] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-27 14:02:26,848 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:51348, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-27 14:02:26,849 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43797] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-27 14:02:26,849 DEBUG [Listener at jenkins-hbase9.apache.org/33737] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-27 14:02:26,851 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:42008, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-27 14:02:26,852 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44379] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-27 14:02:26,853 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-27 14:02:26,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:26,856 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-09-27 14:02:26,856 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-09-27 14:02:26,857 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-27 14:02:26,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-27 14:02:26,859 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/83cb6489ec41d9d9a2caae35c555864f 2023-09-27 14:02:26,859 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71bc6acfb3c8442c70552f5d76eaea8b 2023-09-27 14:02:26,861 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/83cb6489ec41d9d9a2caae35c555864f empty. 2023-09-27 14:02:26,861 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71bc6acfb3c8442c70552f5d76eaea8b empty. 2023-09-27 14:02:26,861 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/83cb6489ec41d9d9a2caae35c555864f 2023-09-27 14:02:26,861 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71bc6acfb3c8442c70552f5d76eaea8b 2023-09-27 14:02:26,861 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-27 14:02:26,871 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-09-27 14:02:26,872 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 83cb6489ec41d9d9a2caae35c555864f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346853.83cb6489ec41d9d9a2caae35c555864f.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp 2023-09-27 14:02:26,873 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 71bc6acfb3c8442c70552f5d76eaea8b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695823346853.71bc6acfb3c8442c70552f5d76eaea8b.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp 2023-09-27 14:02:26,887 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346853.83cb6489ec41d9d9a2caae35c555864f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 14:02:26,887 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695823346853.71bc6acfb3c8442c70552f5d76eaea8b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 14:02:26,887 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 83cb6489ec41d9d9a2caae35c555864f, disabling compactions & flushes 2023-09-27 14:02:26,887 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346853.83cb6489ec41d9d9a2caae35c555864f. 2023-09-27 14:02:26,887 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 71bc6acfb3c8442c70552f5d76eaea8b, disabling compactions & flushes 2023-09-27 14:02:26,887 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346853.83cb6489ec41d9d9a2caae35c555864f. 2023-09-27 14:02:26,888 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695823346853.71bc6acfb3c8442c70552f5d76eaea8b. 2023-09-27 14:02:26,888 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695823346853.71bc6acfb3c8442c70552f5d76eaea8b. 2023-09-27 14:02:26,888 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346853.83cb6489ec41d9d9a2caae35c555864f. after waiting 0 ms 2023-09-27 14:02:26,888 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695823346853.71bc6acfb3c8442c70552f5d76eaea8b. after waiting 0 ms 2023-09-27 14:02:26,888 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695823346853.71bc6acfb3c8442c70552f5d76eaea8b. 2023-09-27 14:02:26,888 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346853.83cb6489ec41d9d9a2caae35c555864f. 2023-09-27 14:02:26,888 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695823346853.71bc6acfb3c8442c70552f5d76eaea8b. 2023-09-27 14:02:26,888 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346853.83cb6489ec41d9d9a2caae35c555864f. 2023-09-27 14:02:26,888 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 71bc6acfb3c8442c70552f5d76eaea8b: 2023-09-27 14:02:26,888 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 83cb6489ec41d9d9a2caae35c555864f: 2023-09-27 14:02:26,891 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-09-27 14:02:26,891 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695823346853.71bc6acfb3c8442c70552f5d76eaea8b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695823346891"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695823346891"}]},"ts":"1695823346891"} 2023-09-27 14:02:26,892 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346853.83cb6489ec41d9d9a2caae35c555864f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695823346891"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695823346891"}]},"ts":"1695823346891"} 2023-09-27 14:02:26,894 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-27 14:02:26,895 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-27 14:02:26,895 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695823346895"}]},"ts":"1695823346895"} 2023-09-27 14:02:26,896 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-09-27 14:02:26,900 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-09-27 14:02:26,901 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 14:02:26,901 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 14:02:26,901 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 14:02:26,901 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 14:02:26,902 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=83cb6489ec41d9d9a2caae35c555864f, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=71bc6acfb3c8442c70552f5d76eaea8b, ASSIGN}] 2023-09-27 14:02:26,904 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=71bc6acfb3c8442c70552f5d76eaea8b, ASSIGN 2023-09-27 14:02:26,904 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=83cb6489ec41d9d9a2caae35c555864f, ASSIGN 2023-09-27 14:02:26,905 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=71bc6acfb3c8442c70552f5d76eaea8b, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,43797,1695823272608; forceNewPlan=false, retain=false 2023-09-27 14:02:26,905 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=83cb6489ec41d9d9a2caae35c555864f, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,44379,1695823272702; forceNewPlan=false, retain=false 2023-09-27 14:02:26,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-27 14:02:27,055 INFO [jenkins-hbase9:32789] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-27 14:02:27,058 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=83cb6489ec41d9d9a2caae35c555864f, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:27,058 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=71bc6acfb3c8442c70552f5d76eaea8b, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:27,058 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346853.83cb6489ec41d9d9a2caae35c555864f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695823347058"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695823347058"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695823347058"}]},"ts":"1695823347058"} 2023-09-27 14:02:27,058 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695823346853.71bc6acfb3c8442c70552f5d76eaea8b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695823347058"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695823347058"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695823347058"}]},"ts":"1695823347058"} 2023-09-27 14:02:27,060 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 83cb6489ec41d9d9a2caae35c555864f, server=jenkins-hbase9.apache.org,44379,1695823272702}] 2023-09-27 14:02:27,060 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 71bc6acfb3c8442c70552f5d76eaea8b, server=jenkins-hbase9.apache.org,43797,1695823272608}] 2023-09-27 14:02:27,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-27 14:02:27,215 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346853.83cb6489ec41d9d9a2caae35c555864f. 2023-09-27 14:02:27,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 83cb6489ec41d9d9a2caae35c555864f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346853.83cb6489ec41d9d9a2caae35c555864f.', STARTKEY => '', ENDKEY => '2'} 2023-09-27 14:02:27,215 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1695823346853.71bc6acfb3c8442c70552f5d76eaea8b. 2023-09-27 14:02:27,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 71bc6acfb3c8442c70552f5d76eaea8b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695823346853.71bc6acfb3c8442c70552f5d76eaea8b.', STARTKEY => '2', ENDKEY => ''} 2023-09-27 14:02:27,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1695823346853.71bc6acfb3c8442c70552f5d76eaea8b. service=AccessControlService 2023-09-27 14:02:27,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346853.83cb6489ec41d9d9a2caae35c555864f. service=AccessControlService 2023-09-27 14:02:27,216 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 14:02:27,216 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 14:02:27,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 71bc6acfb3c8442c70552f5d76eaea8b 2023-09-27 14:02:27,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 83cb6489ec41d9d9a2caae35c555864f 2023-09-27 14:02:27,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695823346853.71bc6acfb3c8442c70552f5d76eaea8b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 14:02:27,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346853.83cb6489ec41d9d9a2caae35c555864f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 14:02:27,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 71bc6acfb3c8442c70552f5d76eaea8b 2023-09-27 14:02:27,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 71bc6acfb3c8442c70552f5d76eaea8b 2023-09-27 14:02:27,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 83cb6489ec41d9d9a2caae35c555864f 2023-09-27 14:02:27,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 83cb6489ec41d9d9a2caae35c555864f 2023-09-27 14:02:27,218 INFO [StoreOpener-71bc6acfb3c8442c70552f5d76eaea8b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 71bc6acfb3c8442c70552f5d76eaea8b 2023-09-27 14:02:27,220 INFO [StoreOpener-83cb6489ec41d9d9a2caae35c555864f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 83cb6489ec41d9d9a2caae35c555864f 2023-09-27 14:02:27,221 DEBUG [StoreOpener-71bc6acfb3c8442c70552f5d76eaea8b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71bc6acfb3c8442c70552f5d76eaea8b/cf 2023-09-27 14:02:27,221 DEBUG [StoreOpener-71bc6acfb3c8442c70552f5d76eaea8b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71bc6acfb3c8442c70552f5d76eaea8b/cf 2023-09-27 14:02:27,221 DEBUG [StoreOpener-83cb6489ec41d9d9a2caae35c555864f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/83cb6489ec41d9d9a2caae35c555864f/cf 2023-09-27 14:02:27,222 DEBUG [StoreOpener-83cb6489ec41d9d9a2caae35c555864f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/83cb6489ec41d9d9a2caae35c555864f/cf 2023-09-27 14:02:27,222 INFO [StoreOpener-71bc6acfb3c8442c70552f5d76eaea8b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 71bc6acfb3c8442c70552f5d76eaea8b columnFamilyName cf 2023-09-27 14:02:27,222 INFO [StoreOpener-83cb6489ec41d9d9a2caae35c555864f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 83cb6489ec41d9d9a2caae35c555864f columnFamilyName cf 2023-09-27 14:02:27,222 INFO [StoreOpener-71bc6acfb3c8442c70552f5d76eaea8b-1] regionserver.HStore(310): Store=71bc6acfb3c8442c70552f5d76eaea8b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 14:02:27,222 INFO [StoreOpener-83cb6489ec41d9d9a2caae35c555864f-1] regionserver.HStore(310): Store=83cb6489ec41d9d9a2caae35c555864f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 14:02:27,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71bc6acfb3c8442c70552f5d76eaea8b 2023-09-27 14:02:27,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/83cb6489ec41d9d9a2caae35c555864f 2023-09-27 14:02:27,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71bc6acfb3c8442c70552f5d76eaea8b 2023-09-27 14:02:27,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/83cb6489ec41d9d9a2caae35c555864f 2023-09-27 14:02:27,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 83cb6489ec41d9d9a2caae35c555864f 2023-09-27 14:02:27,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 71bc6acfb3c8442c70552f5d76eaea8b 2023-09-27 14:02:27,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/83cb6489ec41d9d9a2caae35c555864f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 14:02:27,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71bc6acfb3c8442c70552f5d76eaea8b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 14:02:27,229 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 83cb6489ec41d9d9a2caae35c555864f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74505522, jitterRate=0.11021879315376282}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 14:02:27,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 83cb6489ec41d9d9a2caae35c555864f: 2023-09-27 14:02:27,229 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 71bc6acfb3c8442c70552f5d76eaea8b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72998982, jitterRate=0.08776959776878357}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 14:02:27,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 71bc6acfb3c8442c70552f5d76eaea8b: 2023-09-27 14:02:27,230 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695823346853.71bc6acfb3c8442c70552f5d76eaea8b., pid=70, masterSystemTime=1695823347212 2023-09-27 14:02:27,230 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346853.83cb6489ec41d9d9a2caae35c555864f., pid=69, masterSystemTime=1695823347211 2023-09-27 14:02:27,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346853.83cb6489ec41d9d9a2caae35c555864f. 2023-09-27 14:02:27,231 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346853.83cb6489ec41d9d9a2caae35c555864f. 2023-09-27 14:02:27,232 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=83cb6489ec41d9d9a2caae35c555864f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:27,232 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346853.83cb6489ec41d9d9a2caae35c555864f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695823347232"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695823347232"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695823347232"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695823347232"}]},"ts":"1695823347232"} 2023-09-27 14:02:27,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695823346853.71bc6acfb3c8442c70552f5d76eaea8b. 2023-09-27 14:02:27,232 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1695823346853.71bc6acfb3c8442c70552f5d76eaea8b. 2023-09-27 14:02:27,233 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=71bc6acfb3c8442c70552f5d76eaea8b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:27,233 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695823346853.71bc6acfb3c8442c70552f5d76eaea8b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695823347232"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695823347232"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695823347232"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695823347232"}]},"ts":"1695823347232"} 2023-09-27 14:02:27,235 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-09-27 14:02:27,235 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 83cb6489ec41d9d9a2caae35c555864f, server=jenkins-hbase9.apache.org,44379,1695823272702 in 173 msec 2023-09-27 14:02:27,237 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=68 2023-09-27 14:02:27,237 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 71bc6acfb3c8442c70552f5d76eaea8b, server=jenkins-hbase9.apache.org,43797,1695823272608 in 174 msec 2023-09-27 14:02:27,237 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=83cb6489ec41d9d9a2caae35c555864f, ASSIGN in 334 msec 2023-09-27 14:02:27,238 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=66 2023-09-27 14:02:27,238 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=71bc6acfb3c8442c70552f5d76eaea8b, ASSIGN in 336 msec 2023-09-27 14:02:27,239 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-27 14:02:27,239 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695823347239"}]},"ts":"1695823347239"} 2023-09-27 14:02:27,240 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-09-27 14:02:27,243 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-09-27 14:02:27,243 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-09-27 14:02:27,245 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44379] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-27 14:02:27,246 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:02:27,246 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:02:27,246 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:02:27,246 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:02:27,248 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 14:02:27,248 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 14:02:27,248 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-27 14:02:27,248 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-27 14:02:27,248 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 14:02:27,249 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 14:02:27,249 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-27 14:02:27,249 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-27 14:02:27,249 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 394 msec 2023-09-27 14:02:27,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-27 14:02:27,461 INFO [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-09-27 14:02:27,483 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.HMaster$2(1952): Client=jenkins//172.31.2.10 merge regions 83cb6489ec41d9d9a2caae35c555864f, 71bc6acfb3c8442c70552f5d76eaea8b 2023-09-27 14:02:27,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[83cb6489ec41d9d9a2caae35c555864f, 71bc6acfb3c8442c70552f5d76eaea8b], force=true 2023-09-27 14:02:27,494 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[83cb6489ec41d9d9a2caae35c555864f, 71bc6acfb3c8442c70552f5d76eaea8b], force=true 2023-09-27 14:02:27,494 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[83cb6489ec41d9d9a2caae35c555864f, 71bc6acfb3c8442c70552f5d76eaea8b], force=true 2023-09-27 14:02:27,494 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[83cb6489ec41d9d9a2caae35c555864f, 71bc6acfb3c8442c70552f5d76eaea8b], force=true 2023-09-27 14:02:27,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-27 14:02:27,516 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=83cb6489ec41d9d9a2caae35c555864f, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=71bc6acfb3c8442c70552f5d76eaea8b, UNASSIGN}] 2023-09-27 14:02:27,518 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=83cb6489ec41d9d9a2caae35c555864f, UNASSIGN 2023-09-27 14:02:27,518 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=71bc6acfb3c8442c70552f5d76eaea8b, UNASSIGN 2023-09-27 14:02:27,519 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=83cb6489ec41d9d9a2caae35c555864f, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:27,519 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=71bc6acfb3c8442c70552f5d76eaea8b, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:27,519 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346853.83cb6489ec41d9d9a2caae35c555864f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695823347519"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695823347519"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695823347519"}]},"ts":"1695823347519"} 2023-09-27 14:02:27,519 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695823346853.71bc6acfb3c8442c70552f5d76eaea8b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695823347519"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695823347519"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695823347519"}]},"ts":"1695823347519"} 2023-09-27 14:02:27,521 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 83cb6489ec41d9d9a2caae35c555864f, server=jenkins-hbase9.apache.org,44379,1695823272702}] 2023-09-27 14:02:27,521 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 71bc6acfb3c8442c70552f5d76eaea8b, server=jenkins-hbase9.apache.org,43797,1695823272608}] 2023-09-27 14:02:27,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-27 14:02:27,673 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 83cb6489ec41d9d9a2caae35c555864f 2023-09-27 14:02:27,674 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 83cb6489ec41d9d9a2caae35c555864f, disabling compactions & flushes 2023-09-27 14:02:27,675 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346853.83cb6489ec41d9d9a2caae35c555864f. 2023-09-27 14:02:27,675 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346853.83cb6489ec41d9d9a2caae35c555864f. 2023-09-27 14:02:27,675 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346853.83cb6489ec41d9d9a2caae35c555864f. after waiting 0 ms 2023-09-27 14:02:27,675 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346853.83cb6489ec41d9d9a2caae35c555864f. 2023-09-27 14:02:27,675 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 83cb6489ec41d9d9a2caae35c555864f 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-27 14:02:27,675 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 71bc6acfb3c8442c70552f5d76eaea8b 2023-09-27 14:02:27,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 71bc6acfb3c8442c70552f5d76eaea8b, disabling compactions & flushes 2023-09-27 14:02:27,676 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695823346853.71bc6acfb3c8442c70552f5d76eaea8b. 2023-09-27 14:02:27,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695823346853.71bc6acfb3c8442c70552f5d76eaea8b. 2023-09-27 14:02:27,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695823346853.71bc6acfb3c8442c70552f5d76eaea8b. after waiting 0 ms 2023-09-27 14:02:27,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695823346853.71bc6acfb3c8442c70552f5d76eaea8b. 2023-09-27 14:02:27,676 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 71bc6acfb3c8442c70552f5d76eaea8b 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-27 14:02:27,689 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/83cb6489ec41d9d9a2caae35c555864f/.tmp/cf/db79d504e7ec41d4a291dc48a08212ae 2023-09-27 14:02:27,689 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71bc6acfb3c8442c70552f5d76eaea8b/.tmp/cf/9f458fdc38344cd99d29a85b9f59a695 2023-09-27 14:02:27,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/83cb6489ec41d9d9a2caae35c555864f/.tmp/cf/db79d504e7ec41d4a291dc48a08212ae as hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/83cb6489ec41d9d9a2caae35c555864f/cf/db79d504e7ec41d4a291dc48a08212ae 2023-09-27 14:02:27,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71bc6acfb3c8442c70552f5d76eaea8b/.tmp/cf/9f458fdc38344cd99d29a85b9f59a695 as hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71bc6acfb3c8442c70552f5d76eaea8b/cf/9f458fdc38344cd99d29a85b9f59a695 2023-09-27 14:02:27,701 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71bc6acfb3c8442c70552f5d76eaea8b/cf/9f458fdc38344cd99d29a85b9f59a695, entries=1, sequenceid=5, filesize=4.7 K 2023-09-27 14:02:27,701 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/83cb6489ec41d9d9a2caae35c555864f/cf/db79d504e7ec41d4a291dc48a08212ae, entries=1, sequenceid=5, filesize=4.7 K 2023-09-27 14:02:27,702 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 83cb6489ec41d9d9a2caae35c555864f in 27ms, sequenceid=5, compaction requested=false 2023-09-27 14:02:27,702 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 71bc6acfb3c8442c70552f5d76eaea8b in 26ms, sequenceid=5, compaction requested=false 2023-09-27 14:02:27,702 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-27 14:02:27,702 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-27 14:02:27,713 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71bc6acfb3c8442c70552f5d76eaea8b/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-27 14:02:27,713 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/83cb6489ec41d9d9a2caae35c555864f/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-27 14:02:27,713 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 14:02:27,713 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 14:02:27,713 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346853.83cb6489ec41d9d9a2caae35c555864f. 2023-09-27 14:02:27,713 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 83cb6489ec41d9d9a2caae35c555864f: 2023-09-27 14:02:27,713 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695823346853.71bc6acfb3c8442c70552f5d76eaea8b. 2023-09-27 14:02:27,713 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 71bc6acfb3c8442c70552f5d76eaea8b: 2023-09-27 14:02:27,715 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 83cb6489ec41d9d9a2caae35c555864f 2023-09-27 14:02:27,715 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=83cb6489ec41d9d9a2caae35c555864f, regionState=CLOSED 2023-09-27 14:02:27,715 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346853.83cb6489ec41d9d9a2caae35c555864f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695823347715"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695823347715"}]},"ts":"1695823347715"} 2023-09-27 14:02:27,715 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 71bc6acfb3c8442c70552f5d76eaea8b 2023-09-27 14:02:27,716 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=71bc6acfb3c8442c70552f5d76eaea8b, regionState=CLOSED 2023-09-27 14:02:27,716 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695823346853.71bc6acfb3c8442c70552f5d76eaea8b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695823347716"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695823347716"}]},"ts":"1695823347716"} 2023-09-27 14:02:27,718 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=72 2023-09-27 14:02:27,718 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 83cb6489ec41d9d9a2caae35c555864f, server=jenkins-hbase9.apache.org,44379,1695823272702 in 196 msec 2023-09-27 14:02:27,719 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=73 2023-09-27 14:02:27,719 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 71bc6acfb3c8442c70552f5d76eaea8b, server=jenkins-hbase9.apache.org,43797,1695823272608 in 196 msec 2023-09-27 14:02:27,720 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=83cb6489ec41d9d9a2caae35c555864f, UNASSIGN in 205 msec 2023-09-27 14:02:27,721 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=71 2023-09-27 14:02:27,721 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=71bc6acfb3c8442c70552f5d76eaea8b, UNASSIGN in 203 msec 2023-09-27 14:02:27,763 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/25e0672da671f2e2b15dfa0c0c26b907/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-09-27 14:02:27,765 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346853.83cb6489ec41d9d9a2caae35c555864f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-27 14:02:27,766 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695823346853.71bc6acfb3c8442c70552f5d76eaea8b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-27 14:02:27,766 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346854.25e0672da671f2e2b15dfa0c0c26b907.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-27 14:02:27,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-27 14:02:27,816 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=25e0672da671f2e2b15dfa0c0c26b907, ASSIGN}] 2023-09-27 14:02:27,817 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=25e0672da671f2e2b15dfa0c0c26b907, ASSIGN 2023-09-27 14:02:27,817 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=25e0672da671f2e2b15dfa0c0c26b907, ASSIGN; state=MERGED, location=jenkins-hbase9.apache.org,44379,1695823272702; forceNewPlan=false, retain=false 2023-09-27 14:02:27,968 INFO [jenkins-hbase9:32789] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-27 14:02:27,970 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=25e0672da671f2e2b15dfa0c0c26b907, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:27,970 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346854.25e0672da671f2e2b15dfa0c0c26b907.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695823347969"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695823347969"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695823347969"}]},"ts":"1695823347969"} 2023-09-27 14:02:27,972 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 25e0672da671f2e2b15dfa0c0c26b907, server=jenkins-hbase9.apache.org,44379,1695823272702}] 2023-09-27 14:02:28,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-27 14:02:28,127 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346854.25e0672da671f2e2b15dfa0c0c26b907. 2023-09-27 14:02:28,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 25e0672da671f2e2b15dfa0c0c26b907, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346854.25e0672da671f2e2b15dfa0c0c26b907.', STARTKEY => '', ENDKEY => ''} 2023-09-27 14:02:28,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346854.25e0672da671f2e2b15dfa0c0c26b907. service=AccessControlService 2023-09-27 14:02:28,127 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 14:02:28,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 25e0672da671f2e2b15dfa0c0c26b907 2023-09-27 14:02:28,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346854.25e0672da671f2e2b15dfa0c0c26b907.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 14:02:28,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 25e0672da671f2e2b15dfa0c0c26b907 2023-09-27 14:02:28,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 25e0672da671f2e2b15dfa0c0c26b907 2023-09-27 14:02:28,128 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/25e0672da671f2e2b15dfa0c0c26b907/.regioninfo 2023-09-27 14:02:28,137 INFO [StoreOpener-25e0672da671f2e2b15dfa0c0c26b907-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 25e0672da671f2e2b15dfa0c0c26b907 2023-09-27 14:02:28,137 DEBUG [StoreOpener-25e0672da671f2e2b15dfa0c0c26b907-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/25e0672da671f2e2b15dfa0c0c26b907/cf 2023-09-27 14:02:28,138 DEBUG [StoreOpener-25e0672da671f2e2b15dfa0c0c26b907-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/25e0672da671f2e2b15dfa0c0c26b907/cf 2023-09-27 14:02:28,138 INFO [StoreOpener-25e0672da671f2e2b15dfa0c0c26b907-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 25e0672da671f2e2b15dfa0c0c26b907 columnFamilyName cf 2023-09-27 14:02:28,167 DEBUG [StoreOpener-25e0672da671f2e2b15dfa0c0c26b907-1] regionserver.HStore(539): loaded hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/25e0672da671f2e2b15dfa0c0c26b907/cf/9f458fdc38344cd99d29a85b9f59a695.71bc6acfb3c8442c70552f5d76eaea8b->hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71bc6acfb3c8442c70552f5d76eaea8b/cf/9f458fdc38344cd99d29a85b9f59a695-top 2023-09-27 14:02:28,173 DEBUG [StoreOpener-25e0672da671f2e2b15dfa0c0c26b907-1] regionserver.HStore(539): loaded hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/25e0672da671f2e2b15dfa0c0c26b907/cf/db79d504e7ec41d4a291dc48a08212ae.83cb6489ec41d9d9a2caae35c555864f->hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/83cb6489ec41d9d9a2caae35c555864f/cf/db79d504e7ec41d4a291dc48a08212ae-top 2023-09-27 14:02:28,174 INFO [StoreOpener-25e0672da671f2e2b15dfa0c0c26b907-1] regionserver.HStore(310): Store=25e0672da671f2e2b15dfa0c0c26b907/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 14:02:28,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/25e0672da671f2e2b15dfa0c0c26b907 2023-09-27 14:02:28,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/25e0672da671f2e2b15dfa0c0c26b907 2023-09-27 14:02:28,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 25e0672da671f2e2b15dfa0c0c26b907 2023-09-27 14:02:28,180 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 25e0672da671f2e2b15dfa0c0c26b907; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67558209, jitterRate=0.006695762276649475}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 14:02:28,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 25e0672da671f2e2b15dfa0c0c26b907: 2023-09-27 14:02:28,180 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346854.25e0672da671f2e2b15dfa0c0c26b907., pid=77, masterSystemTime=1695823348123 2023-09-27 14:02:28,181 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346854.25e0672da671f2e2b15dfa0c0c26b907.,because compaction is disabled. 2023-09-27 14:02:28,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346854.25e0672da671f2e2b15dfa0c0c26b907. 2023-09-27 14:02:28,182 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346854.25e0672da671f2e2b15dfa0c0c26b907. 2023-09-27 14:02:28,183 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=25e0672da671f2e2b15dfa0c0c26b907, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:28,183 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346854.25e0672da671f2e2b15dfa0c0c26b907.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695823348183"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695823348183"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695823348183"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695823348183"}]},"ts":"1695823348183"} 2023-09-27 14:02:28,186 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-09-27 14:02:28,186 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 25e0672da671f2e2b15dfa0c0c26b907, server=jenkins-hbase9.apache.org,44379,1695823272702 in 212 msec 2023-09-27 14:02:28,187 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-09-27 14:02:28,187 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=25e0672da671f2e2b15dfa0c0c26b907, ASSIGN in 370 msec 2023-09-27 14:02:28,188 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[83cb6489ec41d9d9a2caae35c555864f, 71bc6acfb3c8442c70552f5d76eaea8b], force=true in 700 msec 2023-09-27 14:02:28,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-27 14:02:28,602 INFO [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-09-27 14:02:28,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-27 14:02:28,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695823348602 (current time:1695823348602). 2023-09-27 14:02:28,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 14:02:28,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(139): Connect 0x47599866 to 127.0.0.1:60071 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 14:02:28,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8256c15, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 14:02:28,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 14:02:28,614 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52580, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 14:02:28,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x47599866 to 127.0.0.1:60071 2023-09-27 14:02:28,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 14:02:28,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(139): Connect 0x0520392b to 127.0.0.1:60071 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 14:02:28,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e310b41, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 14:02:28,623 DEBUG [hconnection-0x2dd79b56-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 14:02:28,625 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52592, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 14:02:28,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 14:02:28,631 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:54176, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 14:02:28,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0520392b to 127.0.0.1:60071 2023-09-27 14:02:28,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 14:02:28,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-27 14:02:28,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 14:02:28,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-27 14:02:28,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-27 14:02:28,636 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-27 14:02:28,637 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1695823948637 2023-09-27 14:02:28,637 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-27 14:02:28,641 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 14:02:28,641 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 14:02:28,641 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-27 14:02:28,642 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-27 14:02:28,643 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 8 msec 2023-09-27 14:02:28,644 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-27 14:02:28,645 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1695823948645 2023-09-27 14:02:28,657 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,657 INFO [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-09-27 14:02:28,657 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:02:28,658 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-09-27 14:02:28,658 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-09-27 14:02:28,659 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,659 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,661 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:02:28,661 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:02:28,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:02:28,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:02:28,661 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:28,661 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:02:28,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:02:28,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:02:28,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:02:28,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:02:28,662 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:28,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,662 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 14:02:28,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,662 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,662 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,663 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-27 14:02:28,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-27 14:02:28,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-27 14:02:28,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,663 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-27 14:02:28,663 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-27 14:02:28,663 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-27 14:02:28,663 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,663 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-27 14:02:28,663 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:02:28,663 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,663 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,665 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-27 14:02:28,665 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-27 14:02:28,664 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-27 14:02:28,665 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:02:28,665 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:02:28,666 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-27 14:02:28,666 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-27 14:02:28,666 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-27 14:02:28,665 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-27 14:02:28,667 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44379,1695823272702' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-27 14:02:28,666 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-27 14:02:28,667 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33659,1695823272661' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-27 14:02:28,667 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,43797,1695823272608' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-27 14:02:28,668 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,669 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,669 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:28,669 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,669 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 14:02:28,669 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:28,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:02:28,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:02:28,670 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,670 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 14:02:28,670 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,670 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 14:02:28,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:02:28,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:02:28,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:28,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:28,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:28,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:02:28,672 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44379,1695823272702' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-09-27 14:02:28,672 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1325f6ad[Count = 0] remaining members to acquire global barrier 2023-09-27 14:02:28,672 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-09-27 14:02:28,672 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,673 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,673 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,673 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,673 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-27 14:02:28,673 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-27 14:02:28,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,673 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase9.apache.org,43797,1695823272608' in zk 2023-09-27 14:02:28,673 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-27 14:02:28,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,673 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:28,674 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 14:02:28,674 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-27 14:02:28,674 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-27 14:02:28,674 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346854.25e0672da671f2e2b15dfa0c0c26b907. 2023-09-27 14:02:28,674 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 14:02:28,674 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 14:02:28,674 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346854.25e0672da671f2e2b15dfa0c0c26b907. started... 2023-09-27 14:02:28,674 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase9.apache.org,33659,1695823272661' in zk 2023-09-27 14:02:28,675 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 25e0672da671f2e2b15dfa0c0c26b907: 2023-09-27 14:02:28,676 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346854.25e0672da671f2e2b15dfa0c0c26b907.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,676 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 14:02:28,676 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/25e0672da671f2e2b15dfa0c0c26b907/cf/9f458fdc38344cd99d29a85b9f59a695.71bc6acfb3c8442c70552f5d76eaea8b->hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71bc6acfb3c8442c70552f5d76eaea8b/cf/9f458fdc38344cd99d29a85b9f59a695-top, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/25e0672da671f2e2b15dfa0c0c26b907/cf/db79d504e7ec41d4a291dc48a08212ae.83cb6489ec41d9d9a2caae35c555864f->hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/83cb6489ec41d9d9a2caae35c555864f/cf/db79d504e7ec41d4a291dc48a08212ae-top] hfiles 2023-09-27 14:02:28,676 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/25e0672da671f2e2b15dfa0c0c26b907/cf/9f458fdc38344cd99d29a85b9f59a695.71bc6acfb3c8442c70552f5d76eaea8b for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,676 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-27 14:02:28,676 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:02:28,676 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-27 14:02:28,677 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/25e0672da671f2e2b15dfa0c0c26b907/cf/db79d504e7ec41d4a291dc48a08212ae.83cb6489ec41d9d9a2caae35c555864f for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,678 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-27 14:02:28,679 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:02:28,679 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-27 14:02:28,691 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346854.25e0672da671f2e2b15dfa0c0c26b907. completed. 2023-09-27 14:02:28,691 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346854.25e0672da671f2e2b15dfa0c0c26b907. 2023-09-27 14:02:28,691 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 14:02:28,692 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 14:02:28,692 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:28,692 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-27 14:02:28,692 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase9.apache.org,44379,1695823272702' in zk 2023-09-27 14:02:28,696 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-27 14:02:28,696 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:28,696 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:02:28,696 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-27 14:02:28,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:28,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:02:28,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:02:28,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:02:28,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:02:28,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:28,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:28,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:28,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:02:28,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:28,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:28,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:28,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase9.apache.org,44379,1695823272702': 2023-09-27 14:02:28,700 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44379,1695823272702' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-09-27 14:02:28,700 INFO [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-09-27 14:02:28,700 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 14:02:28,700 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 14:02:28,700 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,700 INFO [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 14:02:28,701 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,702 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,702 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,702 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:02:28,702 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:02:28,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:02:28,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:02:28,702 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,702 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:02:28,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,702 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:28,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:02:28,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:02:28,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:02:28,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:02:28,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:02:28,703 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:28,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:02:28,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:02:28,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,703 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:28,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:02:28,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:28,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:28,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:28,705 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:28,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:02:28,705 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:28,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,705 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:28,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:28,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:28,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:28,708 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:02:28,708 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:28,708 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,708 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:02:28,708 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,708 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:02:28,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:02:28,708 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:02:28,708 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:02:28,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:02:28,708 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:02:28,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:02:28,708 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:02:28,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:02:28,709 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:02:28,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:02:28,709 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:28,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:02:28,709 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:28,709 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:02:28,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:02:28,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:02:28,709 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:02:28,709 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:28,710 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,710 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:28,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:02:28,710 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:28,710 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,710 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,730 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,730 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-09-27 14:02:28,731 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,731 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,731 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1695823348637Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695823348708 (+71 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695823348708Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695823348712 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695823348723 (+11 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1695823348730 (+7 ms) 2023-09-27 14:02:28,734 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-27 14:02:28,735 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 94 msec 2023-09-27 14:02:28,741 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 14:02:28,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-09-27 14:02:28,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 14:02:28,742 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823348742 2023-09-27 14:02:28,742 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:46363, tgtDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823348742, rawTgtDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823348742, srcFsUri=hdfs://localhost:46363, srcDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30 2023-09-27 14:02:28,765 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:46363, inputRoot=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30 2023-09-27 14:02:28,765 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-420269336_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823348742, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823348742/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:28,765 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:46363, inputRoot=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30, snapshotDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-09-27 14:02:28,774 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823348742/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:29,189 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-27 14:02:29,190 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-27 14:02:29,190 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-27 14:02:29,191 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-27 14:02:29,418 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695823279135_0004_000001 (auth:SIMPLE) 2023-09-27 14:02:30,071 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/hadoop-2829216918907715177.jar 2023-09-27 14:02:30,071 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-27 14:02:30,072 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-27 14:02:30,138 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/hadoop-1094933598876472886.jar 2023-09-27 14:02:30,138 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-27 14:02:30,139 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-27 14:02:30,139 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-27 14:02:30,139 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-27 14:02:30,140 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-27 14:02:30,140 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-27 14:02:30,141 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-27 14:02:30,141 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-27 14:02:30,141 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-27 14:02:30,142 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-27 14:02:30,142 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-27 14:02:30,142 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-27 14:02:30,143 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-27 14:02:30,143 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-27 14:02:30,143 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-27 14:02:30,144 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-27 14:02:30,144 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 14:02:30,145 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 14:02:30,145 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 14:02:30,146 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 14:02:30,146 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 14:02:30,146 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 14:02:30,147 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 14:02:30,542 WARN [Listener at jenkins-hbase9.apache.org/33737] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-27 14:02:30,545 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-09-27 14:02:30,547 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-09-27 14:02:30,610 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 14:02:30,610 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 14:02:30,770 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-27 14:02:31,423 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695823279135_0005_000001 (auth:SIMPLE) 2023-09-27 14:02:35,223 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695823279135_0005_000001 (auth:SIMPLE) 2023-09-27 14:02:37,445 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695823279135_0005_000001 (auth:SIMPLE) 2023-09-27 14:02:39,867 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695823279135_0005_000001 (auth:SIMPLE) 2023-09-27 14:02:41,717 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-27 14:02:41,718 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-27 14:02:41,725 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:41,725 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-27 14:02:41,725 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-27 14:02:41,725 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1724413351_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:41,726 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(367): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-27 14:02:41,726 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(367): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-27 14:02:41,726 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1724413351_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823348742/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823348742/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:41,726 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(367): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823348742/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-27 14:02:41,726 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(367): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823348742/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-27 14:02:41,733 INFO [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:41,733 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:41,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:41,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-27 14:02:41,738 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695823361738"}]},"ts":"1695823361738"} 2023-09-27 14:02:41,739 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-09-27 14:02:41,741 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-09-27 14:02:41,741 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=25e0672da671f2e2b15dfa0c0c26b907, UNASSIGN}] 2023-09-27 14:02:41,744 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=25e0672da671f2e2b15dfa0c0c26b907, UNASSIGN 2023-09-27 14:02:41,744 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=25e0672da671f2e2b15dfa0c0c26b907, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:41,745 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346854.25e0672da671f2e2b15dfa0c0c26b907.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695823361744"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695823361744"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695823361744"}]},"ts":"1695823361744"} 2023-09-27 14:02:41,746 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 25e0672da671f2e2b15dfa0c0c26b907, server=jenkins-hbase9.apache.org,44379,1695823272702}] 2023-09-27 14:02:41,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-27 14:02:41,898 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 25e0672da671f2e2b15dfa0c0c26b907 2023-09-27 14:02:41,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 25e0672da671f2e2b15dfa0c0c26b907, disabling compactions & flushes 2023-09-27 14:02:41,898 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346854.25e0672da671f2e2b15dfa0c0c26b907. 2023-09-27 14:02:41,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346854.25e0672da671f2e2b15dfa0c0c26b907. 2023-09-27 14:02:41,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346854.25e0672da671f2e2b15dfa0c0c26b907. after waiting 0 ms 2023-09-27 14:02:41,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346854.25e0672da671f2e2b15dfa0c0c26b907. 2023-09-27 14:02:41,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/25e0672da671f2e2b15dfa0c0c26b907/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-09-27 14:02:41,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 14:02:41,911 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346854.25e0672da671f2e2b15dfa0c0c26b907. 2023-09-27 14:02:41,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 25e0672da671f2e2b15dfa0c0c26b907: 2023-09-27 14:02:41,912 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 25e0672da671f2e2b15dfa0c0c26b907 2023-09-27 14:02:41,913 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=25e0672da671f2e2b15dfa0c0c26b907, regionState=CLOSED 2023-09-27 14:02:41,913 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346854.25e0672da671f2e2b15dfa0c0c26b907.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695823361913"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695823361913"}]},"ts":"1695823361913"} 2023-09-27 14:02:41,916 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-09-27 14:02:41,916 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 25e0672da671f2e2b15dfa0c0c26b907, server=jenkins-hbase9.apache.org,44379,1695823272702 in 168 msec 2023-09-27 14:02:41,917 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-09-27 14:02:41,917 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=25e0672da671f2e2b15dfa0c0c26b907, UNASSIGN in 175 msec 2023-09-27 14:02:41,918 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695823361918"}]},"ts":"1695823361918"} 2023-09-27 14:02:41,919 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-09-27 14:02:41,921 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-09-27 14:02:41,922 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 187 msec 2023-09-27 14:02:42,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-27 14:02:42,040 INFO [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-09-27 14:02:42,041 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:42,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:42,044 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:42,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:42,045 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:42,046 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44379] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:42,049 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71bc6acfb3c8442c70552f5d76eaea8b 2023-09-27 14:02:42,049 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/25e0672da671f2e2b15dfa0c0c26b907 2023-09-27 14:02:42,049 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/83cb6489ec41d9d9a2caae35c555864f 2023-09-27 14:02:42,050 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:42,050 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:42,050 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:42,050 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:42,050 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-27 14:02:42,050 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-27 14:02:42,051 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-27 14:02:42,051 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71bc6acfb3c8442c70552f5d76eaea8b/cf, FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71bc6acfb3c8442c70552f5d76eaea8b/recovered.edits] 2023-09-27 14:02:42,051 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/25e0672da671f2e2b15dfa0c0c26b907/cf, FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/25e0672da671f2e2b15dfa0c0c26b907/recovered.edits] 2023-09-27 14:02:42,051 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:42,052 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:42,052 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/83cb6489ec41d9d9a2caae35c555864f/cf, FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/83cb6489ec41d9d9a2caae35c555864f/recovered.edits] 2023-09-27 14:02:42,052 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:02:42,052 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-09-27 14:02:42,052 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:02:42,052 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:02:42,052 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:42,052 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-27 14:02:42,052 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:02:42,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-27 14:02:42,053 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 14:02:42,053 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 14:02:42,053 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 14:02:42,053 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 14:02:42,056 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/25e0672da671f2e2b15dfa0c0c26b907/cf/9f458fdc38344cd99d29a85b9f59a695.71bc6acfb3c8442c70552f5d76eaea8b to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/25e0672da671f2e2b15dfa0c0c26b907/cf/9f458fdc38344cd99d29a85b9f59a695.71bc6acfb3c8442c70552f5d76eaea8b 2023-09-27 14:02:42,056 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71bc6acfb3c8442c70552f5d76eaea8b/cf/9f458fdc38344cd99d29a85b9f59a695 to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71bc6acfb3c8442c70552f5d76eaea8b/cf/9f458fdc38344cd99d29a85b9f59a695 2023-09-27 14:02:42,057 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/83cb6489ec41d9d9a2caae35c555864f/cf/db79d504e7ec41d4a291dc48a08212ae to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/83cb6489ec41d9d9a2caae35c555864f/cf/db79d504e7ec41d4a291dc48a08212ae 2023-09-27 14:02:42,058 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/25e0672da671f2e2b15dfa0c0c26b907/cf/db79d504e7ec41d4a291dc48a08212ae.83cb6489ec41d9d9a2caae35c555864f to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/25e0672da671f2e2b15dfa0c0c26b907/cf/db79d504e7ec41d4a291dc48a08212ae.83cb6489ec41d9d9a2caae35c555864f 2023-09-27 14:02:42,060 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71bc6acfb3c8442c70552f5d76eaea8b/recovered.edits/8.seqid to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71bc6acfb3c8442c70552f5d76eaea8b/recovered.edits/8.seqid 2023-09-27 14:02:42,061 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/83cb6489ec41d9d9a2caae35c555864f/recovered.edits/8.seqid to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/83cb6489ec41d9d9a2caae35c555864f/recovered.edits/8.seqid 2023-09-27 14:02:42,061 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71bc6acfb3c8442c70552f5d76eaea8b 2023-09-27 14:02:42,061 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/83cb6489ec41d9d9a2caae35c555864f 2023-09-27 14:02:42,062 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/25e0672da671f2e2b15dfa0c0c26b907/recovered.edits/12.seqid to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/25e0672da671f2e2b15dfa0c0c26b907/recovered.edits/12.seqid 2023-09-27 14:02:42,062 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/25e0672da671f2e2b15dfa0c0c26b907 2023-09-27 14:02:42,062 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-27 14:02:42,064 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:42,067 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-09-27 14:02:42,069 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-09-27 14:02:42,070 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:42,070 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-09-27 14:02:42,071 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346854.25e0672da671f2e2b15dfa0c0c26b907.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695823362070"}]},"ts":"9223372036854775807"} 2023-09-27 14:02:42,072 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-09-27 14:02:42,072 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 25e0672da671f2e2b15dfa0c0c26b907, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695823346854.25e0672da671f2e2b15dfa0c0c26b907.', STARTKEY => '', ENDKEY => ''}] 2023-09-27 14:02:42,072 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-09-27 14:02:42,072 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695823362072"}]},"ts":"9223372036854775807"} 2023-09-27 14:02:42,074 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-09-27 14:02:42,076 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:42,077 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 35 msec 2023-09-27 14:02:42,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-27 14:02:42,154 INFO [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-09-27 14:02:42,155 INFO [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:42,155 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:42,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:42,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-27 14:02:42,160 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695823362160"}]},"ts":"1695823362160"} 2023-09-27 14:02:42,161 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-09-27 14:02:42,163 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-09-27 14:02:42,164 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9b9534e5f3a0b031775fb6842af05749, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=93b1e42539f4b8b79573a0e13c781e61, UNASSIGN}] 2023-09-27 14:02:42,166 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9b9534e5f3a0b031775fb6842af05749, UNASSIGN 2023-09-27 14:02:42,166 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=93b1e42539f4b8b79573a0e13c781e61, UNASSIGN 2023-09-27 14:02:42,167 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=9b9534e5f3a0b031775fb6842af05749, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:42,167 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=93b1e42539f4b8b79573a0e13c781e61, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:42,167 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695823345481.9b9534e5f3a0b031775fb6842af05749.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695823362167"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695823362167"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695823362167"}]},"ts":"1695823362167"} 2023-09-27 14:02:42,167 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695823345481.93b1e42539f4b8b79573a0e13c781e61.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695823362167"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695823362167"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695823362167"}]},"ts":"1695823362167"} 2023-09-27 14:02:42,168 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 9b9534e5f3a0b031775fb6842af05749, server=jenkins-hbase9.apache.org,43797,1695823272608}] 2023-09-27 14:02:42,169 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 93b1e42539f4b8b79573a0e13c781e61, server=jenkins-hbase9.apache.org,44379,1695823272702}] 2023-09-27 14:02:42,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-27 14:02:42,320 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 93b1e42539f4b8b79573a0e13c781e61 2023-09-27 14:02:42,320 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 9b9534e5f3a0b031775fb6842af05749 2023-09-27 14:02:42,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 93b1e42539f4b8b79573a0e13c781e61, disabling compactions & flushes 2023-09-27 14:02:42,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 9b9534e5f3a0b031775fb6842af05749, disabling compactions & flushes 2023-09-27 14:02:42,321 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695823345481.93b1e42539f4b8b79573a0e13c781e61. 2023-09-27 14:02:42,321 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695823345481.9b9534e5f3a0b031775fb6842af05749. 2023-09-27 14:02:42,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695823345481.93b1e42539f4b8b79573a0e13c781e61. 2023-09-27 14:02:42,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695823345481.9b9534e5f3a0b031775fb6842af05749. 2023-09-27 14:02:42,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695823345481.93b1e42539f4b8b79573a0e13c781e61. after waiting 0 ms 2023-09-27 14:02:42,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695823345481.93b1e42539f4b8b79573a0e13c781e61. 2023-09-27 14:02:42,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695823345481.9b9534e5f3a0b031775fb6842af05749. after waiting 0 ms 2023-09-27 14:02:42,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695823345481.9b9534e5f3a0b031775fb6842af05749. 2023-09-27 14:02:42,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion/93b1e42539f4b8b79573a0e13c781e61/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 14:02:42,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b9534e5f3a0b031775fb6842af05749/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 14:02:42,338 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 14:02:42,339 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695823345481.93b1e42539f4b8b79573a0e13c781e61. 2023-09-27 14:02:42,339 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 14:02:42,339 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 93b1e42539f4b8b79573a0e13c781e61: 2023-09-27 14:02:42,340 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695823345481.9b9534e5f3a0b031775fb6842af05749. 2023-09-27 14:02:42,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 9b9534e5f3a0b031775fb6842af05749: 2023-09-27 14:02:42,341 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 93b1e42539f4b8b79573a0e13c781e61 2023-09-27 14:02:42,342 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=93b1e42539f4b8b79573a0e13c781e61, regionState=CLOSED 2023-09-27 14:02:42,342 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 9b9534e5f3a0b031775fb6842af05749 2023-09-27 14:02:42,342 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695823345481.93b1e42539f4b8b79573a0e13c781e61.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695823362342"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695823362342"}]},"ts":"1695823362342"} 2023-09-27 14:02:42,342 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=9b9534e5f3a0b031775fb6842af05749, regionState=CLOSED 2023-09-27 14:02:42,342 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695823345481.9b9534e5f3a0b031775fb6842af05749.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695823362342"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695823362342"}]},"ts":"1695823362342"} 2023-09-27 14:02:42,345 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-09-27 14:02:42,345 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 93b1e42539f4b8b79573a0e13c781e61, server=jenkins-hbase9.apache.org,44379,1695823272702 in 174 msec 2023-09-27 14:02:42,346 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-09-27 14:02:42,346 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 9b9534e5f3a0b031775fb6842af05749, server=jenkins-hbase9.apache.org,43797,1695823272608 in 176 msec 2023-09-27 14:02:42,346 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=93b1e42539f4b8b79573a0e13c781e61, UNASSIGN in 181 msec 2023-09-27 14:02:42,347 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=84 2023-09-27 14:02:42,347 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9b9534e5f3a0b031775fb6842af05749, UNASSIGN in 182 msec 2023-09-27 14:02:42,347 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695823362347"}]},"ts":"1695823362347"} 2023-09-27 14:02:42,349 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-09-27 14:02:42,351 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-09-27 14:02:42,353 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 197 msec 2023-09-27 14:02:42,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-27 14:02:42,462 INFO [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-09-27 14:02:42,463 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:42,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:42,466 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:42,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:42,467 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:42,468 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44379] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:42,471 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:42,471 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:42,471 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:42,471 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:42,471 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-27 14:02:42,471 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b9534e5f3a0b031775fb6842af05749 2023-09-27 14:02:42,471 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-27 14:02:42,471 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-27 14:02:42,471 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/93b1e42539f4b8b79573a0e13c781e61 2023-09-27 14:02:42,472 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-27 14:02:42,473 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:42,473 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:42,473 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:42,473 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:42,473 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:02:42,473 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:02:42,473 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:02:42,473 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:02:42,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-27 14:02:42,474 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b9534e5f3a0b031775fb6842af05749/cf, FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b9534e5f3a0b031775fb6842af05749/recovered.edits] 2023-09-27 14:02:42,475 DEBUG [HFileArchiver-16] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/93b1e42539f4b8b79573a0e13c781e61/cf, FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/93b1e42539f4b8b79573a0e13c781e61/recovered.edits] 2023-09-27 14:02:42,479 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b9534e5f3a0b031775fb6842af05749/cf/def07b897fec4b01b73819f1308f091f to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b9534e5f3a0b031775fb6842af05749/cf/def07b897fec4b01b73819f1308f091f 2023-09-27 14:02:42,479 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/93b1e42539f4b8b79573a0e13c781e61/cf/eeff04a649dc435dbc8bdaababd76506 to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/93b1e42539f4b8b79573a0e13c781e61/cf/eeff04a649dc435dbc8bdaababd76506 2023-09-27 14:02:42,482 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b9534e5f3a0b031775fb6842af05749/recovered.edits/9.seqid to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b9534e5f3a0b031775fb6842af05749/recovered.edits/9.seqid 2023-09-27 14:02:42,482 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/93b1e42539f4b8b79573a0e13c781e61/recovered.edits/9.seqid to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/93b1e42539f4b8b79573a0e13c781e61/recovered.edits/9.seqid 2023-09-27 14:02:42,482 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b9534e5f3a0b031775fb6842af05749 2023-09-27 14:02:42,482 DEBUG [HFileArchiver-16] backup.HFileArchiver(596): Deleted hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/93b1e42539f4b8b79573a0e13c781e61 2023-09-27 14:02:42,483 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-27 14:02:42,483 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-27 14:02:42,484 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-09-27 14:02:42,486 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230927f55d84fb87a845c8a21e5f97c4ce9de8 to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230927f55d84fb87a845c8a21e5f97c4ce9de8 2023-09-27 14:02:42,488 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230927c36814b2f4a6489482ac5fafcb61ed78 to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230927c36814b2f4a6489482ac5fafcb61ed78 2023-09-27 14:02:42,488 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-27 14:02:42,490 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:42,492 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-09-27 14:02:42,494 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-09-27 14:02:42,495 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:42,495 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-09-27 14:02:42,495 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695823345481.9b9534e5f3a0b031775fb6842af05749.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695823362495"}]},"ts":"9223372036854775807"} 2023-09-27 14:02:42,495 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695823345481.93b1e42539f4b8b79573a0e13c781e61.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695823362495"}]},"ts":"9223372036854775807"} 2023-09-27 14:02:42,497 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-27 14:02:42,497 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9b9534e5f3a0b031775fb6842af05749, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695823345481.9b9534e5f3a0b031775fb6842af05749.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 93b1e42539f4b8b79573a0e13c781e61, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695823345481.93b1e42539f4b8b79573a0e13c781e61.', STARTKEY => '1', ENDKEY => ''}] 2023-09-27 14:02:42,497 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-09-27 14:02:42,497 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695823362497"}]},"ts":"9223372036854775807"} 2023-09-27 14:02:42,498 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-09-27 14:02:42,501 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:42,502 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 38 msec 2023-09-27 14:02:42,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-27 14:02:42,575 INFO [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-09-27 14:02:42,585 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-27 14:02:42,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:42,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-27 14:02:42,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 14:02:42,592 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-09-27 14:02:42,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 14:02:42,619 INFO [Listener at jenkins-hbase9.apache.org/33737] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=759 (was 747) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5ef90b03-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5ef90b03-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5ef90b03-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1724413351_17 at /127.0.0.1:38516 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1724413351_17 at /127.0.0.1:50284 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5ef90b03-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1724413351_17 at /127.0.0.1:41306 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2107514926) connection to jenkins-hbase9.apache.org/172.31.2.10:40507 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5ef90b03-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3960 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_910023985_1 at /127.0.0.1:38512 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_910023985_1 at /127.0.0.1:41282 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5ef90b03-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=913 (was 905) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=156 (was 162), ProcessCount=168 (was 168), AvailableMemoryMB=8668 (was 8735) 2023-09-27 14:02:42,620 WARN [Listener at jenkins-hbase9.apache.org/33737] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-09-27 14:02:42,640 INFO [Listener at jenkins-hbase9.apache.org/33737] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=759, OpenFileDescriptor=913, MaxFileDescriptor=60000, SystemLoadAverage=156, ProcessCount=168, AvailableMemoryMB=8668 2023-09-27 14:02:42,640 WARN [Listener at jenkins-hbase9.apache.org/33737] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-09-27 14:02:42,642 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-27 14:02:42,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-27 14:02:42,645 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-27 14:02:42,645 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-09-27 14:02:42,646 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-27 14:02:42,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-27 14:02:42,648 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testEmptyExportFileSystemState/60c95adfa39254d5baedc7017ee4d1a7 2023-09-27 14:02:42,648 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testEmptyExportFileSystemState/858592cb41dc3fc26fbacffab3b83d1f 2023-09-27 14:02:42,648 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testEmptyExportFileSystemState/60c95adfa39254d5baedc7017ee4d1a7 empty. 2023-09-27 14:02:42,649 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testEmptyExportFileSystemState/858592cb41dc3fc26fbacffab3b83d1f empty. 2023-09-27 14:02:42,649 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testEmptyExportFileSystemState/60c95adfa39254d5baedc7017ee4d1a7 2023-09-27 14:02:42,649 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testEmptyExportFileSystemState/858592cb41dc3fc26fbacffab3b83d1f 2023-09-27 14:02:42,649 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-27 14:02:42,659 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-27 14:02:42,660 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 60c95adfa39254d5baedc7017ee4d1a7, NAME => 'testtb-testEmptyExportFileSystemState,,1695823362642.60c95adfa39254d5baedc7017ee4d1a7.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp 2023-09-27 14:02:42,661 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 858592cb41dc3fc26fbacffab3b83d1f, NAME => 'testtb-testEmptyExportFileSystemState,1,1695823362642.858592cb41dc3fc26fbacffab3b83d1f.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp 2023-09-27 14:02:42,676 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695823362642.60c95adfa39254d5baedc7017ee4d1a7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 14:02:42,676 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 60c95adfa39254d5baedc7017ee4d1a7, disabling compactions & flushes 2023-09-27 14:02:42,676 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695823362642.60c95adfa39254d5baedc7017ee4d1a7. 2023-09-27 14:02:42,676 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695823362642.60c95adfa39254d5baedc7017ee4d1a7. 2023-09-27 14:02:42,676 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695823362642.60c95adfa39254d5baedc7017ee4d1a7. after waiting 0 ms 2023-09-27 14:02:42,676 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695823362642.60c95adfa39254d5baedc7017ee4d1a7. 2023-09-27 14:02:42,676 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695823362642.60c95adfa39254d5baedc7017ee4d1a7. 2023-09-27 14:02:42,676 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695823362642.858592cb41dc3fc26fbacffab3b83d1f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 14:02:42,676 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 60c95adfa39254d5baedc7017ee4d1a7: 2023-09-27 14:02:42,677 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 858592cb41dc3fc26fbacffab3b83d1f, disabling compactions & flushes 2023-09-27 14:02:42,677 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695823362642.858592cb41dc3fc26fbacffab3b83d1f. 2023-09-27 14:02:42,677 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695823362642.858592cb41dc3fc26fbacffab3b83d1f. 2023-09-27 14:02:42,677 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695823362642.858592cb41dc3fc26fbacffab3b83d1f. after waiting 0 ms 2023-09-27 14:02:42,677 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695823362642.858592cb41dc3fc26fbacffab3b83d1f. 2023-09-27 14:02:42,677 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695823362642.858592cb41dc3fc26fbacffab3b83d1f. 2023-09-27 14:02:42,677 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 858592cb41dc3fc26fbacffab3b83d1f: 2023-09-27 14:02:42,679 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-27 14:02:42,680 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695823362642.60c95adfa39254d5baedc7017ee4d1a7.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695823362679"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695823362679"}]},"ts":"1695823362679"} 2023-09-27 14:02:42,680 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695823362642.858592cb41dc3fc26fbacffab3b83d1f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695823362679"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695823362679"}]},"ts":"1695823362679"} 2023-09-27 14:02:42,681 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-27 14:02:42,682 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-27 14:02:42,682 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695823362682"}]},"ts":"1695823362682"} 2023-09-27 14:02:42,683 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-09-27 14:02:42,686 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-09-27 14:02:42,687 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 14:02:42,687 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 14:02:42,688 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 14:02:42,688 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 14:02:42,688 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=60c95adfa39254d5baedc7017ee4d1a7, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=858592cb41dc3fc26fbacffab3b83d1f, ASSIGN}] 2023-09-27 14:02:42,690 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=60c95adfa39254d5baedc7017ee4d1a7, ASSIGN 2023-09-27 14:02:42,690 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=858592cb41dc3fc26fbacffab3b83d1f, ASSIGN 2023-09-27 14:02:42,691 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=60c95adfa39254d5baedc7017ee4d1a7, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,43797,1695823272608; forceNewPlan=false, retain=false 2023-09-27 14:02:42,691 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=858592cb41dc3fc26fbacffab3b83d1f, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,44379,1695823272702; forceNewPlan=false, retain=false 2023-09-27 14:02:42,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-27 14:02:42,841 INFO [jenkins-hbase9:32789] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-27 14:02:42,844 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=858592cb41dc3fc26fbacffab3b83d1f, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:42,844 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=60c95adfa39254d5baedc7017ee4d1a7, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:42,844 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695823362642.858592cb41dc3fc26fbacffab3b83d1f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695823362844"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695823362844"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695823362844"}]},"ts":"1695823362844"} 2023-09-27 14:02:42,844 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695823362642.60c95adfa39254d5baedc7017ee4d1a7.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695823362844"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695823362844"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695823362844"}]},"ts":"1695823362844"} 2023-09-27 14:02:42,846 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 858592cb41dc3fc26fbacffab3b83d1f, server=jenkins-hbase9.apache.org,44379,1695823272702}] 2023-09-27 14:02:42,846 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 60c95adfa39254d5baedc7017ee4d1a7, server=jenkins-hbase9.apache.org,43797,1695823272608}] 2023-09-27 14:02:42,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-27 14:02:43,000 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1695823362642.858592cb41dc3fc26fbacffab3b83d1f. 2023-09-27 14:02:43,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 858592cb41dc3fc26fbacffab3b83d1f, NAME => 'testtb-testEmptyExportFileSystemState,1,1695823362642.858592cb41dc3fc26fbacffab3b83d1f.', STARTKEY => '1', ENDKEY => ''} 2023-09-27 14:02:43,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1695823362642.858592cb41dc3fc26fbacffab3b83d1f. service=AccessControlService 2023-09-27 14:02:43,001 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1695823362642.60c95adfa39254d5baedc7017ee4d1a7. 2023-09-27 14:02:43,001 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 14:02:43,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 60c95adfa39254d5baedc7017ee4d1a7, NAME => 'testtb-testEmptyExportFileSystemState,,1695823362642.60c95adfa39254d5baedc7017ee4d1a7.', STARTKEY => '', ENDKEY => '1'} 2023-09-27 14:02:43,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 858592cb41dc3fc26fbacffab3b83d1f 2023-09-27 14:02:43,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695823362642.858592cb41dc3fc26fbacffab3b83d1f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 14:02:43,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 858592cb41dc3fc26fbacffab3b83d1f 2023-09-27 14:02:43,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1695823362642.60c95adfa39254d5baedc7017ee4d1a7. service=AccessControlService 2023-09-27 14:02:43,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 858592cb41dc3fc26fbacffab3b83d1f 2023-09-27 14:02:43,002 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 14:02:43,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 60c95adfa39254d5baedc7017ee4d1a7 2023-09-27 14:02:43,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695823362642.60c95adfa39254d5baedc7017ee4d1a7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 14:02:43,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 60c95adfa39254d5baedc7017ee4d1a7 2023-09-27 14:02:43,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 60c95adfa39254d5baedc7017ee4d1a7 2023-09-27 14:02:43,003 INFO [StoreOpener-858592cb41dc3fc26fbacffab3b83d1f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 858592cb41dc3fc26fbacffab3b83d1f 2023-09-27 14:02:43,003 INFO [StoreOpener-60c95adfa39254d5baedc7017ee4d1a7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 60c95adfa39254d5baedc7017ee4d1a7 2023-09-27 14:02:43,004 DEBUG [StoreOpener-858592cb41dc3fc26fbacffab3b83d1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testEmptyExportFileSystemState/858592cb41dc3fc26fbacffab3b83d1f/cf 2023-09-27 14:02:43,004 DEBUG [StoreOpener-858592cb41dc3fc26fbacffab3b83d1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testEmptyExportFileSystemState/858592cb41dc3fc26fbacffab3b83d1f/cf 2023-09-27 14:02:43,004 DEBUG [StoreOpener-60c95adfa39254d5baedc7017ee4d1a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testEmptyExportFileSystemState/60c95adfa39254d5baedc7017ee4d1a7/cf 2023-09-27 14:02:43,004 DEBUG [StoreOpener-60c95adfa39254d5baedc7017ee4d1a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testEmptyExportFileSystemState/60c95adfa39254d5baedc7017ee4d1a7/cf 2023-09-27 14:02:43,004 INFO [StoreOpener-858592cb41dc3fc26fbacffab3b83d1f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 858592cb41dc3fc26fbacffab3b83d1f columnFamilyName cf 2023-09-27 14:02:43,004 INFO [StoreOpener-60c95adfa39254d5baedc7017ee4d1a7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 60c95adfa39254d5baedc7017ee4d1a7 columnFamilyName cf 2023-09-27 14:02:43,006 INFO [StoreOpener-858592cb41dc3fc26fbacffab3b83d1f-1] regionserver.HStore(310): Store=858592cb41dc3fc26fbacffab3b83d1f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 14:02:43,006 INFO [StoreOpener-60c95adfa39254d5baedc7017ee4d1a7-1] regionserver.HStore(310): Store=60c95adfa39254d5baedc7017ee4d1a7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 14:02:43,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testEmptyExportFileSystemState/60c95adfa39254d5baedc7017ee4d1a7 2023-09-27 14:02:43,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testEmptyExportFileSystemState/858592cb41dc3fc26fbacffab3b83d1f 2023-09-27 14:02:43,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testEmptyExportFileSystemState/60c95adfa39254d5baedc7017ee4d1a7 2023-09-27 14:02:43,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testEmptyExportFileSystemState/858592cb41dc3fc26fbacffab3b83d1f 2023-09-27 14:02:43,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 60c95adfa39254d5baedc7017ee4d1a7 2023-09-27 14:02:43,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 858592cb41dc3fc26fbacffab3b83d1f 2023-09-27 14:02:43,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testEmptyExportFileSystemState/60c95adfa39254d5baedc7017ee4d1a7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 14:02:43,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testEmptyExportFileSystemState/858592cb41dc3fc26fbacffab3b83d1f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 14:02:43,013 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 60c95adfa39254d5baedc7017ee4d1a7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69274348, jitterRate=0.032268226146698}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 14:02:43,013 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 858592cb41dc3fc26fbacffab3b83d1f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69292371, jitterRate=0.032536789774894714}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 14:02:43,013 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 60c95adfa39254d5baedc7017ee4d1a7: 2023-09-27 14:02:43,013 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 858592cb41dc3fc26fbacffab3b83d1f: 2023-09-27 14:02:43,013 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1695823362642.858592cb41dc3fc26fbacffab3b83d1f., pid=93, masterSystemTime=1695823362997 2023-09-27 14:02:43,013 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1695823362642.60c95adfa39254d5baedc7017ee4d1a7., pid=94, masterSystemTime=1695823362999 2023-09-27 14:02:43,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1695823362642.858592cb41dc3fc26fbacffab3b83d1f. 2023-09-27 14:02:43,015 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1695823362642.858592cb41dc3fc26fbacffab3b83d1f. 2023-09-27 14:02:43,015 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=858592cb41dc3fc26fbacffab3b83d1f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:43,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1695823362642.60c95adfa39254d5baedc7017ee4d1a7. 2023-09-27 14:02:43,015 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1695823362642.60c95adfa39254d5baedc7017ee4d1a7. 2023-09-27 14:02:43,015 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1695823362642.858592cb41dc3fc26fbacffab3b83d1f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695823363015"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695823363015"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695823363015"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695823363015"}]},"ts":"1695823363015"} 2023-09-27 14:02:43,016 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=60c95adfa39254d5baedc7017ee4d1a7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:43,016 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1695823362642.60c95adfa39254d5baedc7017ee4d1a7.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695823363016"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695823363016"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695823363016"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695823363016"}]},"ts":"1695823363016"} 2023-09-27 14:02:43,018 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=92 2023-09-27 14:02:43,018 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 858592cb41dc3fc26fbacffab3b83d1f, server=jenkins-hbase9.apache.org,44379,1695823272702 in 171 msec 2023-09-27 14:02:43,019 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=91 2023-09-27 14:02:43,019 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 60c95adfa39254d5baedc7017ee4d1a7, server=jenkins-hbase9.apache.org,43797,1695823272608 in 172 msec 2023-09-27 14:02:43,020 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=858592cb41dc3fc26fbacffab3b83d1f, ASSIGN in 330 msec 2023-09-27 14:02:43,021 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=91, resume processing ppid=90 2023-09-27 14:02:43,021 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=60c95adfa39254d5baedc7017ee4d1a7, ASSIGN in 331 msec 2023-09-27 14:02:43,021 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-27 14:02:43,022 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695823363021"}]},"ts":"1695823363021"} 2023-09-27 14:02:43,023 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-09-27 14:02:43,025 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-27 14:02:43,025 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-09-27 14:02:43,027 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44379] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-27 14:02:43,029 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:02:43,029 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:02:43,029 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:02:43,029 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:02:43,030 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-27 14:02:43,030 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-27 14:02:43,030 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-27 14:02:43,030 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-27 14:02:43,032 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 388 msec 2023-09-27 14:02:43,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-27 14:02:43,250 INFO [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-09-27 14:02:43,253 DEBUG [Listener at jenkins-hbase9.apache.org/33737] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-27 14:02:43,253 DEBUG [Listener at jenkins-hbase9.apache.org/33737] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695823362642.60c95adfa39254d5baedc7017ee4d1a7. 2023-09-27 14:02:43,255 INFO [Listener at jenkins-hbase9.apache.org/33737] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 14:02:43,269 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 14:02:43,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695823363269 (current time:1695823363269). 2023-09-27 14:02:43,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 14:02:43,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(139): Connect 0x092a6202 to 127.0.0.1:60071 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 14:02:43,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@178a8258, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 14:02:43,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 14:02:43,282 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:38474, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 14:02:43,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x092a6202 to 127.0.0.1:60071 2023-09-27 14:02:43,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 14:02:43,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(139): Connect 0x1c24ea18 to 127.0.0.1:60071 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 14:02:43,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46c4a1ec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 14:02:43,296 DEBUG [hconnection-0x59f632e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 14:02:43,299 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:38480, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 14:02:43,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 14:02:43,306 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52492, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 14:02:43,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c24ea18 to 127.0.0.1:60071 2023-09-27 14:02:43,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 14:02:43,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-27 14:02:43,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 14:02:43,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 14:02:43,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-27 14:02:43,312 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-27 14:02:43,312 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695823963312 2023-09-27 14:02:43,312 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-27 14:02:43,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 14:02:43,314 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 14:02:43,314 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 14:02:43,314 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-27 14:02:43,315 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-27 14:02:43,317 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-09-27 14:02:43,320 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-27 14:02:43,320 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695823963320 2023-09-27 14:02:43,329 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,330 INFO [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-09-27 14:02:43,330 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:02:43,331 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-27 14:02:43,331 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-27 14:02:43,332 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,332 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,338 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:02:43,338 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:02:43,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:02:43,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:02:43,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:02:43,338 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:02:43,338 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:43,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:02:43,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:02:43,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:02:43,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,338 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:43,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,339 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:43,339 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,339 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,339 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,339 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:43,339 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 14:02:43,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-27 14:02:43,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-27 14:02:43,339 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-27 14:02:43,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-27 14:02:43,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,340 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-27 14:02:43,340 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,340 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-27 14:02:43,340 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-27 14:02:43,340 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,340 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:02:43,340 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,340 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-27 14:02:43,342 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-27 14:02:43,342 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:02:43,341 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-27 14:02:43,343 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-27 14:02:43,343 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-27 14:02:43,342 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:02:43,343 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,43797,1695823272608' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-27 14:02:43,343 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-27 14:02:43,344 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-27 14:02:43,344 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-27 14:02:43,344 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44379,1695823272702' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-27 14:02:43,344 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33659,1695823272661' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-27 14:02:43,347 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,347 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:43,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:43,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:02:43,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:02:43,347 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:43,347 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:02:43,348 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,348 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,348 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 14:02:43,348 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,348 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 14:02:43,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:02:43,348 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,348 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 14:02:43,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:43,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:43,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:43,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:02:43,350 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,43797,1695823272608' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-27 14:02:43,350 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@34e21ad5[Count = 1] remaining members to acquire global barrier 2023-09-27 14:02:43,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:43,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:02:43,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:02:43,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:02:43,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:02:43,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:43,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:43,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:43,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:02:43,352 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44379,1695823272702' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-27 14:02:43,352 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@34e21ad5[Count = 0] remaining members to acquire global barrier 2023-09-27 14:02:43,352 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-27 14:02:43,352 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,353 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,353 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,353 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,354 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-27 14:02:43,354 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:43,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,354 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-27 14:02:43,354 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-27 14:02:43,354 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-27 14:02:43,354 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 14:02:43,354 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695823362642.60c95adfa39254d5baedc7017ee4d1a7. 2023-09-27 14:02:43,354 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:43,354 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695823362642.858592cb41dc3fc26fbacffab3b83d1f. 2023-09-27 14:02:43,354 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 14:02:43,354 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695823362642.60c95adfa39254d5baedc7017ee4d1a7. started... 2023-09-27 14:02:43,354 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 14:02:43,354 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 14:02:43,354 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 14:02:43,354 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,33659,1695823272661' in zk 2023-09-27 14:02:43,354 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695823362642.858592cb41dc3fc26fbacffab3b83d1f. started... 2023-09-27 14:02:43,354 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 60c95adfa39254d5baedc7017ee4d1a7: 2023-09-27 14:02:43,356 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 858592cb41dc3fc26fbacffab3b83d1f: 2023-09-27 14:02:43,356 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695823362642.858592cb41dc3fc26fbacffab3b83d1f.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,356 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695823362642.60c95adfa39254d5baedc7017ee4d1a7.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,356 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 14:02:43,356 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 14:02:43,357 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 14:02:43,357 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 14:02:43,358 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-27 14:02:43,358 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:02:43,358 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-27 14:02:43,368 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695823362642.60c95adfa39254d5baedc7017ee4d1a7. completed. 2023-09-27 14:02:43,368 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695823362642.60c95adfa39254d5baedc7017ee4d1a7. 2023-09-27 14:02:43,368 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 14:02:43,368 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 14:02:43,368 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:43,369 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-27 14:02:43,369 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,43797,1695823272608' in zk 2023-09-27 14:02:43,370 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695823362642.858592cb41dc3fc26fbacffab3b83d1f. completed. 2023-09-27 14:02:43,371 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695823362642.858592cb41dc3fc26fbacffab3b83d1f. 2023-09-27 14:02:43,371 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 14:02:43,371 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 14:02:43,371 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:43,371 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-27 14:02:43,371 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,44379,1695823272702' in zk 2023-09-27 14:02:43,372 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-27 14:02:43,372 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:43,373 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:02:43,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:43,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:02:43,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:02:43,373 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-27 14:02:43,375 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:43,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:02:43,375 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-27 14:02:43,375 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:02:43,375 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-27 14:02:43,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:02:43,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:43,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:43,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:43,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:02:43,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:43,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:43,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:43,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,43797,1695823272608': 2023-09-27 14:02:43,379 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,43797,1695823272608' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-27 14:02:43,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:43,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:02:43,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:02:43,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:02:43,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:02:43,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:43,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:43,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:43,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:02:43,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:43,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:43,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:43,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,44379,1695823272702': 2023-09-27 14:02:43,383 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44379,1695823272702' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-27 14:02:43,383 INFO [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-09-27 14:02:43,383 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 14:02:43,383 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 14:02:43,383 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,383 INFO [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 14:02:43,384 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,384 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,384 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:02:43,384 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,384 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:02:43,385 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:02:43,384 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,386 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:43,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:02:43,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:02:43,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:02:43,387 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:43,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:02:43,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:02:43,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:02:43,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:02:43,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:02:43,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:02:43,387 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:43,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:02:43,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:43,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:43,389 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:43,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:43,389 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:43,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:02:43,389 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:43,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:43,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:43,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:43,392 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:43,392 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,392 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:02:43,392 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:43,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:02:43,392 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:02:43,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:02:43,393 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:02:43,393 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:43,392 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:02:43,393 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:02:43,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:02:43,393 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,393 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:02:43,394 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-27 14:02:43,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:02:43,393 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:02:43,395 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:02:43,395 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 14:02:43,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:02:43,394 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:43,394 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:02:43,395 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:02:43,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:02:43,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:02:43,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:02:43,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:02:43,395 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:43,395 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:43,395 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,395 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,395 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-27 14:02:43,407 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,407 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,414 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 14:02:43,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-27 14:02:43,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-27 14:02:43,416 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 14:02:43,423 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,424 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-27 14:02:43,424 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,424 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,424 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695823363312Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695823363407 (+95 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695823363407Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1695823363407Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1695823363410 (+3 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695823363418 (+8 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695823363424 (+6 ms) 2023-09-27 14:02:43,428 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-27 14:02:43,429 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 114 msec 2023-09-27 14:02:43,616 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 14:02:43,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-27 14:02:43,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 14:02:43,619 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43797] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1695823362642.60c95adfa39254d5baedc7017ee4d1a7. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 14:02:43,620 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44379] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1695823362642.858592cb41dc3fc26fbacffab3b83d1f. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 14:02:43,623 DEBUG [Listener at jenkins-hbase9.apache.org/33737] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-27 14:02:43,623 DEBUG [Listener at jenkins-hbase9.apache.org/33737] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695823362642.60c95adfa39254d5baedc7017ee4d1a7. 2023-09-27 14:02:43,623 INFO [Listener at jenkins-hbase9.apache.org/33737] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 14:02:43,634 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 14:02:43,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695823363634 (current time:1695823363634). 2023-09-27 14:02:43,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 14:02:43,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(139): Connect 0x508de019 to 127.0.0.1:60071 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 14:02:43,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ef57f35, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 14:02:43,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 14:02:43,648 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:38494, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 14:02:43,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x508de019 to 127.0.0.1:60071 2023-09-27 14:02:43,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 14:02:43,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(139): Connect 0x6f826598 to 127.0.0.1:60071 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 14:02:43,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5030dd59, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 14:02:43,657 DEBUG [hconnection-0x55391cbd-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 14:02:43,658 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:38502, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 14:02:43,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 14:02:43,663 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52504, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 14:02:43,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6f826598 to 127.0.0.1:60071 2023-09-27 14:02:43,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 14:02:43,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-27 14:02:43,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 14:02:43,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 14:02:43,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-27 14:02:43,669 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-27 14:02:43,669 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695823963669 2023-09-27 14:02:43,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 14:02:43,669 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-27 14:02:43,671 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 14:02:43,671 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 14:02:43,674 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-27 14:02:43,674 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-27 14:02:43,675 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-09-27 14:02:43,676 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-27 14:02:43,677 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695823963677 2023-09-27 14:02:43,685 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,685 INFO [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-09-27 14:02:43,685 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:02:43,686 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-27 14:02:43,686 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-27 14:02:43,687 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,687 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,694 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:02:43,694 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:02:43,694 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:02:43,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:02:43,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:02:43,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:02:43,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:02:43,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:02:43,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:02:43,694 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:43,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,695 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:43,695 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:43,695 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,695 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,695 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,695 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:43,695 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 14:02:43,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-27 14:02:43,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-27 14:02:43,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-27 14:02:43,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,696 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-27 14:02:43,696 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-27 14:02:43,696 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-27 14:02:43,696 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,696 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-27 14:02:43,696 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,696 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:02:43,696 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-27 14:02:43,698 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,698 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-27 14:02:43,698 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-27 14:02:43,698 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:02:43,698 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:02:43,698 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-27 14:02:43,699 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-27 14:02:43,702 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-27 14:02:43,703 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-27 14:02:43,699 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33659,1695823272661' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-27 14:02:43,703 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,43797,1695823272608' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-27 14:02:43,703 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-27 14:02:43,703 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44379,1695823272702' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-27 14:02:43,704 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,704 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,704 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:43,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:43,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:02:43,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:02:43,705 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:43,705 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,705 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,705 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,706 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 14:02:43,705 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 14:02:43,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:02:43,706 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,706 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 14:02:43,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:02:43,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:43,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:43,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:43,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:02:43,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44379,1695823272702' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-27 14:02:43,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6bd97ee8[Count = 1] remaining members to acquire global barrier 2023-09-27 14:02:43,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:43,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:02:43,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:02:43,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:02:43,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:02:43,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:43,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:43,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:43,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:02:43,709 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,43797,1695823272608' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-27 14:02:43,710 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6bd97ee8[Count = 0] remaining members to acquire global barrier 2023-09-27 14:02:43,710 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-27 14:02:43,710 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,714 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,714 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,714 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,714 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-27 14:02:43,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,714 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:43,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,715 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 14:02:43,715 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-27 14:02:43,715 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-27 14:02:43,715 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695823362642.60c95adfa39254d5baedc7017ee4d1a7. 2023-09-27 14:02:43,715 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 14:02:43,715 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695823362642.60c95adfa39254d5baedc7017ee4d1a7. started... 2023-09-27 14:02:43,715 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-27 14:02:43,715 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:43,715 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,33659,1695823272661' in zk 2023-09-27 14:02:43,715 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 14:02:43,715 INFO [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 60c95adfa39254d5baedc7017ee4d1a7 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-27 14:02:43,715 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 14:02:43,715 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 14:02:43,715 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695823362642.858592cb41dc3fc26fbacffab3b83d1f. 2023-09-27 14:02:43,715 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695823362642.858592cb41dc3fc26fbacffab3b83d1f. started... 2023-09-27 14:02:43,715 INFO [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 858592cb41dc3fc26fbacffab3b83d1f 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-27 14:02:43,717 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-27 14:02:43,717 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:02:43,717 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-27 14:02:43,736 INFO [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309274888e185eca74a99af08b2ccef65199d to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309274888e185eca74a99af08b2ccef65199d 2023-09-27 14:02:43,737 INFO [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309273d1f5b750ca14a79af7a090e102575b5 to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309273d1f5b750ca14a79af7a090e102575b5 2023-09-27 14:02:43,746 INFO [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testEmptyExportFileSystemState/60c95adfa39254d5baedc7017ee4d1a7/.tmp/cf/68d8ad56f23245a894c318f6cd34f9a4 2023-09-27 14:02:43,746 INFO [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testEmptyExportFileSystemState/858592cb41dc3fc26fbacffab3b83d1f/.tmp/cf/481723a2996c474884c46716ffb83966 2023-09-27 14:02:43,753 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testEmptyExportFileSystemState/60c95adfa39254d5baedc7017ee4d1a7/.tmp/cf/68d8ad56f23245a894c318f6cd34f9a4 as hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testEmptyExportFileSystemState/60c95adfa39254d5baedc7017ee4d1a7/cf/68d8ad56f23245a894c318f6cd34f9a4 2023-09-27 14:02:43,753 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testEmptyExportFileSystemState/858592cb41dc3fc26fbacffab3b83d1f/.tmp/cf/481723a2996c474884c46716ffb83966 as hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testEmptyExportFileSystemState/858592cb41dc3fc26fbacffab3b83d1f/cf/481723a2996c474884c46716ffb83966 2023-09-27 14:02:43,758 INFO [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testEmptyExportFileSystemState/858592cb41dc3fc26fbacffab3b83d1f/cf/481723a2996c474884c46716ffb83966, entries=48, sequenceid=6, filesize=13.2 K 2023-09-27 14:02:43,759 INFO [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testEmptyExportFileSystemState/60c95adfa39254d5baedc7017ee4d1a7/cf/68d8ad56f23245a894c318f6cd34f9a4, entries=2, sequenceid=6, filesize=5.2 K 2023-09-27 14:02:43,759 INFO [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 858592cb41dc3fc26fbacffab3b83d1f in 44ms, sequenceid=6, compaction requested=false 2023-09-27 14:02:43,759 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-27 14:02:43,759 INFO [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 60c95adfa39254d5baedc7017ee4d1a7 in 44ms, sequenceid=6, compaction requested=false 2023-09-27 14:02:43,759 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-27 14:02:43,762 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 858592cb41dc3fc26fbacffab3b83d1f: 2023-09-27 14:02:43,762 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 60c95adfa39254d5baedc7017ee4d1a7: 2023-09-27 14:02:43,762 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695823362642.858592cb41dc3fc26fbacffab3b83d1f.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,762 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695823362642.60c95adfa39254d5baedc7017ee4d1a7.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,762 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 14:02:43,763 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 14:02:43,763 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testEmptyExportFileSystemState/858592cb41dc3fc26fbacffab3b83d1f/cf/481723a2996c474884c46716ffb83966] hfiles 2023-09-27 14:02:43,763 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testEmptyExportFileSystemState/60c95adfa39254d5baedc7017ee4d1a7/cf/68d8ad56f23245a894c318f6cd34f9a4] hfiles 2023-09-27 14:02:43,763 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testEmptyExportFileSystemState/858592cb41dc3fc26fbacffab3b83d1f/cf/481723a2996c474884c46716ffb83966 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,763 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testEmptyExportFileSystemState/60c95adfa39254d5baedc7017ee4d1a7/cf/68d8ad56f23245a894c318f6cd34f9a4 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,770 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695823362642.60c95adfa39254d5baedc7017ee4d1a7. completed. 2023-09-27 14:02:43,771 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695823362642.60c95adfa39254d5baedc7017ee4d1a7. 2023-09-27 14:02:43,771 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695823362642.858592cb41dc3fc26fbacffab3b83d1f. completed. 2023-09-27 14:02:43,771 DEBUG [rs(jenkins-hbase9.apache.org,44379,1695823272702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695823362642.858592cb41dc3fc26fbacffab3b83d1f. 2023-09-27 14:02:43,771 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 14:02:43,771 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 14:02:43,771 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 14:02:43,771 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 14:02:43,771 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:43,771 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:43,771 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-27 14:02:43,771 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 14:02:43,771 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-27 14:02:43,771 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,44379,1695823272702' in zk 2023-09-27 14:02:43,771 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,43797,1695823272608' in zk 2023-09-27 14:02:43,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-27 14:02:43,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-27 14:02:43,772 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 14:02:43,773 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:43,773 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-27 14:02:43,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:43,773 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:02:43,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:02:43,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:02:43,773 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-27 14:02:43,775 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:43,775 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-27 14:02:43,775 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:02:43,775 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-27 14:02:43,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:02:43,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:02:43,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:43,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:43,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:43,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:02:43,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:43,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:43,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:43,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,43797,1695823272608': 2023-09-27 14:02:43,779 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,43797,1695823272608' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-27 14:02:43,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:43,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:02:43,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:02:43,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:02:43,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:02:43,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:43,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:43,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:43,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:02:43,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:43,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:43,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:43,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,44379,1695823272702': 2023-09-27 14:02:43,782 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44379,1695823272702' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-27 14:02:43,782 INFO [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-09-27 14:02:43,782 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 14:02:43,782 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 14:02:43,782 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,782 INFO [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 14:02:43,785 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,785 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,785 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:02:43,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:02:43,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,785 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:02:43,785 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,785 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:02:43,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,786 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:43,786 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:02:43,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:02:43,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:02:43,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:02:43,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:02:43,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:02:43,786 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:43,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:02:43,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:02:43,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,786 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:43,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:02:43,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:43,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:43,788 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:43,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:43,788 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:43,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:02:43,788 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:43,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:43,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:43,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:43,791 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:43,791 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:02:43,791 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:02:43,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:02:43,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:02:43,791 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,791 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:02:43,791 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:02:43,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:02:43,791 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:43,791 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:02:43,791 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:43,791 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-27 14:02:43,791 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:02:43,791 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:02:43,792 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:02:43,792 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 14:02:43,791 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:02:43,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:02:43,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:02:43,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:02:43,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:02:43,791 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:02:43,794 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:43,794 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,794 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:43,794 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:43,794 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,794 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:02:43,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:02:43,794 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309273d1f5b750ca14a79af7a090e102575b5, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309274888e185eca74a99af08b2ccef65199d] mob files 2023-09-27 14:02:43,794 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309273d1f5b750ca14a79af7a090e102575b5 2023-09-27 14:02:43,794 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309274888e185eca74a99af08b2ccef65199d 2023-09-27 14:02:43,801 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,802 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,819 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,820 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-27 14:02:43,820 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,820 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,820 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695823363669Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695823363801 (+132 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1695823363801Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1695823363801Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1695823363804 (+3 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1695823363812 (+8 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695823363820 (+8 ms) 2023-09-27 14:02:43,823 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-27 14:02:43,824 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 152 msec 2023-09-27 14:02:43,973 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 14:02:43,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-27 14:02:43,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 14:02:43,974 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823363974 2023-09-27 14:02:43,974 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:46363, tgtDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823363974, rawTgtDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823363974, srcFsUri=hdfs://localhost:46363, srcDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30 2023-09-27 14:02:43,997 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:46363, inputRoot=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30 2023-09-27 14:02:43,997 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_392550052_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823363974, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823363974/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:43,997 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:46363, inputRoot=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30, snapshotDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-09-27 14:02:44,004 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823363974/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:44,058 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-27 14:02:44,058 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-27 14:02:44,059 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-27 14:02:44,059 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-27 14:02:44,936 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/hadoop-6649610661053629863.jar 2023-09-27 14:02:44,936 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-27 14:02:44,936 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-27 14:02:45,008 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/hadoop-5436739882445948563.jar 2023-09-27 14:02:45,009 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-27 14:02:45,009 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-27 14:02:45,010 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-27 14:02:45,010 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-27 14:02:45,011 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-27 14:02:45,011 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-27 14:02:45,011 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-27 14:02:45,012 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-27 14:02:45,012 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-27 14:02:45,012 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-27 14:02:45,013 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-27 14:02:45,013 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-27 14:02:45,013 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-27 14:02:45,014 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-27 14:02:45,014 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-27 14:02:45,014 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-27 14:02:45,015 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 14:02:45,015 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 14:02:45,016 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 14:02:45,016 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 14:02:45,016 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 14:02:45,017 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 14:02:45,017 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 14:02:45,392 WARN [Listener at jenkins-hbase9.apache.org/33737] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-27 14:02:45,394 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-09-27 14:02:46,055 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 14:02:46,055 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 14:02:46,057 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695823279135_0005_000001 (auth:SIMPLE) 2023-09-27 14:02:46,613 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695823279135_0006_000001 (auth:SIMPLE) 2023-09-27 14:02:47,505 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-27 14:02:50,426 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695823279135_0006_000001 (auth:SIMPLE) 2023-09-27 14:02:52,746 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-27 14:02:52,747 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-27 14:02:52,752 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:52,752 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-27 14:02:52,753 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-27 14:02:52,753 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1724413351_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:52,753 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(367): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-27 14:02:52,753 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(367): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-27 14:02:52,753 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1724413351_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823363974/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823363974/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:52,754 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(367): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823363974/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-27 14:02:52,754 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(367): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823363974/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-27 14:02:52,760 INFO [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-09-27 14:02:52,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testEmptyExportFileSystemState 2023-09-27 14:02:52,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-27 14:02:52,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-27 14:02:52,765 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695823372765"}]},"ts":"1695823372765"} 2023-09-27 14:02:52,767 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-09-27 14:02:52,768 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-09-27 14:02:52,769 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=60c95adfa39254d5baedc7017ee4d1a7, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=858592cb41dc3fc26fbacffab3b83d1f, UNASSIGN}] 2023-09-27 14:02:52,771 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=60c95adfa39254d5baedc7017ee4d1a7, UNASSIGN 2023-09-27 14:02:52,771 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=858592cb41dc3fc26fbacffab3b83d1f, UNASSIGN 2023-09-27 14:02:52,772 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=60c95adfa39254d5baedc7017ee4d1a7, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:52,772 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=858592cb41dc3fc26fbacffab3b83d1f, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:52,772 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695823362642.60c95adfa39254d5baedc7017ee4d1a7.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695823372772"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695823372772"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695823372772"}]},"ts":"1695823372772"} 2023-09-27 14:02:52,772 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695823362642.858592cb41dc3fc26fbacffab3b83d1f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695823372772"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695823372772"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695823372772"}]},"ts":"1695823372772"} 2023-09-27 14:02:52,773 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 60c95adfa39254d5baedc7017ee4d1a7, server=jenkins-hbase9.apache.org,43797,1695823272608}] 2023-09-27 14:02:52,774 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 858592cb41dc3fc26fbacffab3b83d1f, server=jenkins-hbase9.apache.org,44379,1695823272702}] 2023-09-27 14:02:52,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-27 14:02:52,926 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 60c95adfa39254d5baedc7017ee4d1a7 2023-09-27 14:02:52,926 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 858592cb41dc3fc26fbacffab3b83d1f 2023-09-27 14:02:52,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 60c95adfa39254d5baedc7017ee4d1a7, disabling compactions & flushes 2023-09-27 14:02:52,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 858592cb41dc3fc26fbacffab3b83d1f, disabling compactions & flushes 2023-09-27 14:02:52,926 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695823362642.60c95adfa39254d5baedc7017ee4d1a7. 2023-09-27 14:02:52,926 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695823362642.858592cb41dc3fc26fbacffab3b83d1f. 2023-09-27 14:02:52,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695823362642.60c95adfa39254d5baedc7017ee4d1a7. 2023-09-27 14:02:52,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695823362642.858592cb41dc3fc26fbacffab3b83d1f. 2023-09-27 14:02:52,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695823362642.60c95adfa39254d5baedc7017ee4d1a7. after waiting 0 ms 2023-09-27 14:02:52,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695823362642.60c95adfa39254d5baedc7017ee4d1a7. 2023-09-27 14:02:52,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695823362642.858592cb41dc3fc26fbacffab3b83d1f. after waiting 0 ms 2023-09-27 14:02:52,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695823362642.858592cb41dc3fc26fbacffab3b83d1f. 2023-09-27 14:02:52,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testEmptyExportFileSystemState/60c95adfa39254d5baedc7017ee4d1a7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 14:02:52,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testEmptyExportFileSystemState/858592cb41dc3fc26fbacffab3b83d1f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 14:02:52,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 14:02:52,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 14:02:52,936 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695823362642.60c95adfa39254d5baedc7017ee4d1a7. 2023-09-27 14:02:52,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 60c95adfa39254d5baedc7017ee4d1a7: 2023-09-27 14:02:52,937 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695823362642.858592cb41dc3fc26fbacffab3b83d1f. 2023-09-27 14:02:52,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 858592cb41dc3fc26fbacffab3b83d1f: 2023-09-27 14:02:52,938 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 60c95adfa39254d5baedc7017ee4d1a7 2023-09-27 14:02:52,939 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=60c95adfa39254d5baedc7017ee4d1a7, regionState=CLOSED 2023-09-27 14:02:52,939 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695823362642.60c95adfa39254d5baedc7017ee4d1a7.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695823372939"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695823372939"}]},"ts":"1695823372939"} 2023-09-27 14:02:52,939 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 858592cb41dc3fc26fbacffab3b83d1f 2023-09-27 14:02:52,939 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=858592cb41dc3fc26fbacffab3b83d1f, regionState=CLOSED 2023-09-27 14:02:52,939 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695823362642.858592cb41dc3fc26fbacffab3b83d1f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695823372939"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695823372939"}]},"ts":"1695823372939"} 2023-09-27 14:02:52,942 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-09-27 14:02:52,942 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 60c95adfa39254d5baedc7017ee4d1a7, server=jenkins-hbase9.apache.org,43797,1695823272608 in 167 msec 2023-09-27 14:02:52,942 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=101 2023-09-27 14:02:52,942 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 858592cb41dc3fc26fbacffab3b83d1f, server=jenkins-hbase9.apache.org,44379,1695823272702 in 167 msec 2023-09-27 14:02:52,942 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=60c95adfa39254d5baedc7017ee4d1a7, UNASSIGN in 173 msec 2023-09-27 14:02:52,943 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=99 2023-09-27 14:02:52,943 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=858592cb41dc3fc26fbacffab3b83d1f, UNASSIGN in 173 msec 2023-09-27 14:02:52,944 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695823372944"}]},"ts":"1695823372944"} 2023-09-27 14:02:52,945 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-09-27 14:02:52,948 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-09-27 14:02:52,950 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 189 msec 2023-09-27 14:02:53,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-27 14:02:53,067 INFO [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-09-27 14:02:53,068 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testEmptyExportFileSystemState 2023-09-27 14:02:53,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-27 14:02:53,071 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-27 14:02:53,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-09-27 14:02:53,072 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-27 14:02:53,074 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44379] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-09-27 14:02:53,076 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testEmptyExportFileSystemState/60c95adfa39254d5baedc7017ee4d1a7 2023-09-27 14:02:53,076 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testEmptyExportFileSystemState/858592cb41dc3fc26fbacffab3b83d1f 2023-09-27 14:02:53,076 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-27 14:02:53,076 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-27 14:02:53,076 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-27 14:02:53,076 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-27 14:02:53,077 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-27 14:02:53,077 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-27 14:02:53,077 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-27 14:02:53,077 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-27 14:02:53,078 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-27 14:02:53,078 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-27 14:02:53,078 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:02:53,079 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-27 14:02:53,079 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testEmptyExportFileSystemState/60c95adfa39254d5baedc7017ee4d1a7/cf, FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testEmptyExportFileSystemState/60c95adfa39254d5baedc7017ee4d1a7/recovered.edits] 2023-09-27 14:02:53,078 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:02:53,079 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:02:53,079 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-27 14:02:53,079 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:02:53,079 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testEmptyExportFileSystemState/858592cb41dc3fc26fbacffab3b83d1f/cf, FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testEmptyExportFileSystemState/858592cb41dc3fc26fbacffab3b83d1f/recovered.edits] 2023-09-27 14:02:53,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-27 14:02:53,084 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testEmptyExportFileSystemState/858592cb41dc3fc26fbacffab3b83d1f/cf/481723a2996c474884c46716ffb83966 to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/archive/data/default/testtb-testEmptyExportFileSystemState/858592cb41dc3fc26fbacffab3b83d1f/cf/481723a2996c474884c46716ffb83966 2023-09-27 14:02:53,085 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testEmptyExportFileSystemState/60c95adfa39254d5baedc7017ee4d1a7/cf/68d8ad56f23245a894c318f6cd34f9a4 to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/archive/data/default/testtb-testEmptyExportFileSystemState/60c95adfa39254d5baedc7017ee4d1a7/cf/68d8ad56f23245a894c318f6cd34f9a4 2023-09-27 14:02:53,088 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testEmptyExportFileSystemState/858592cb41dc3fc26fbacffab3b83d1f/recovered.edits/9.seqid to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/archive/data/default/testtb-testEmptyExportFileSystemState/858592cb41dc3fc26fbacffab3b83d1f/recovered.edits/9.seqid 2023-09-27 14:02:53,088 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testEmptyExportFileSystemState/60c95adfa39254d5baedc7017ee4d1a7/recovered.edits/9.seqid to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/archive/data/default/testtb-testEmptyExportFileSystemState/60c95adfa39254d5baedc7017ee4d1a7/recovered.edits/9.seqid 2023-09-27 14:02:53,088 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testEmptyExportFileSystemState/858592cb41dc3fc26fbacffab3b83d1f 2023-09-27 14:02:53,088 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testEmptyExportFileSystemState/60c95adfa39254d5baedc7017ee4d1a7 2023-09-27 14:02:53,089 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-27 14:02:53,089 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-27 14:02:53,090 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-09-27 14:02:53,093 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309273d1f5b750ca14a79af7a090e102575b5 to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309273d1f5b750ca14a79af7a090e102575b5 2023-09-27 14:02:53,094 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309274888e185eca74a99af08b2ccef65199d to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309274888e185eca74a99af08b2ccef65199d 2023-09-27 14:02:53,095 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-27 14:02:53,097 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-27 14:02:53,099 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-09-27 14:02:53,101 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-09-27 14:02:53,102 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-27 14:02:53,102 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-09-27 14:02:53,102 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1695823362642.60c95adfa39254d5baedc7017ee4d1a7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695823373102"}]},"ts":"9223372036854775807"} 2023-09-27 14:02:53,102 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1695823362642.858592cb41dc3fc26fbacffab3b83d1f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695823373102"}]},"ts":"9223372036854775807"} 2023-09-27 14:02:53,104 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-27 14:02:53,104 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 60c95adfa39254d5baedc7017ee4d1a7, NAME => 'testtb-testEmptyExportFileSystemState,,1695823362642.60c95adfa39254d5baedc7017ee4d1a7.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 858592cb41dc3fc26fbacffab3b83d1f, NAME => 'testtb-testEmptyExportFileSystemState,1,1695823362642.858592cb41dc3fc26fbacffab3b83d1f.', STARTKEY => '1', ENDKEY => ''}] 2023-09-27 14:02:53,104 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-09-27 14:02:53,104 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695823373104"}]},"ts":"9223372036854775807"} 2023-09-27 14:02:53,106 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-09-27 14:02:53,108 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-27 14:02:53,109 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 40 msec 2023-09-27 14:02:53,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-27 14:02:53,181 INFO [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-09-27 14:02:53,188 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-09-27 14:02:53,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:53,192 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-09-27 14:02:53,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-09-27 14:02:53,220 INFO [Listener at jenkins-hbase9.apache.org/33737] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=766 (was 759) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5ef90b03-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1724413351_17 at /127.0.0.1:59558 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5ef90b03-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1151344692_1 at /127.0.0.1:59448 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5ef90b03-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2107514926) connection to jenkins-hbase9.apache.org/172.31.2.10:33737 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4611 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (2107514926) connection to jenkins-hbase9.apache.org/172.31.2.10:35661 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2107514926) connection to jenkins-hbase9.apache.org/172.31.2.10:36019 from appattempt_1695823279135_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (2107514926) connection to jenkins-hbase9.apache.org/172.31.2.10:35509 from appattempt_1695823279135_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1151344692_1 at /127.0.0.1:41932 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1724413351_17 at /127.0.0.1:59470 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5ef90b03-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=942 (was 913) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=148 (was 156), ProcessCount=170 (was 168) - ProcessCount LEAK? -, AvailableMemoryMB=8633 (was 8668) 2023-09-27 14:02:53,220 WARN [Listener at jenkins-hbase9.apache.org/33737] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-27 14:02:53,242 INFO [Listener at jenkins-hbase9.apache.org/33737] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766, OpenFileDescriptor=942, MaxFileDescriptor=60000, SystemLoadAverage=148, ProcessCount=170, AvailableMemoryMB=8633 2023-09-27 14:02:53,242 WARN [Listener at jenkins-hbase9.apache.org/33737] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-27 14:02:53,243 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-27 14:02:53,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,247 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-09-27 14:02:53,247 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-09-27 14:02:53,247 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-27 14:02:53,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-27 14:02:53,250 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3e9e4d8f614cd8b2366857cb76b507ad 2023-09-27 14:02:53,250 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/16f8da04aeb68a4a0bff66ba155bf84b 2023-09-27 14:02:53,250 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3e9e4d8f614cd8b2366857cb76b507ad empty. 2023-09-27 14:02:53,250 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/16f8da04aeb68a4a0bff66ba155bf84b empty. 2023-09-27 14:02:53,251 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3e9e4d8f614cd8b2366857cb76b507ad 2023-09-27 14:02:53,251 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/16f8da04aeb68a4a0bff66ba155bf84b 2023-09-27 14:02:53,251 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-27 14:02:53,265 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-09-27 14:02:53,266 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3e9e4d8f614cd8b2366857cb76b507ad, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695823373243.3e9e4d8f614cd8b2366857cb76b507ad.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp 2023-09-27 14:02:53,266 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 16f8da04aeb68a4a0bff66ba155bf84b, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695823373243.16f8da04aeb68a4a0bff66ba155bf84b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp 2023-09-27 14:02:53,285 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695823373243.16f8da04aeb68a4a0bff66ba155bf84b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 14:02:53,285 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 16f8da04aeb68a4a0bff66ba155bf84b, disabling compactions & flushes 2023-09-27 14:02:53,285 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695823373243.16f8da04aeb68a4a0bff66ba155bf84b. 2023-09-27 14:02:53,285 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695823373243.16f8da04aeb68a4a0bff66ba155bf84b. 2023-09-27 14:02:53,285 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695823373243.16f8da04aeb68a4a0bff66ba155bf84b. after waiting 0 ms 2023-09-27 14:02:53,285 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695823373243.16f8da04aeb68a4a0bff66ba155bf84b. 2023-09-27 14:02:53,285 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695823373243.16f8da04aeb68a4a0bff66ba155bf84b. 2023-09-27 14:02:53,285 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 16f8da04aeb68a4a0bff66ba155bf84b: 2023-09-27 14:02:53,287 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695823373243.3e9e4d8f614cd8b2366857cb76b507ad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 14:02:53,287 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 3e9e4d8f614cd8b2366857cb76b507ad, disabling compactions & flushes 2023-09-27 14:02:53,287 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695823373243.3e9e4d8f614cd8b2366857cb76b507ad. 2023-09-27 14:02:53,288 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695823373243.3e9e4d8f614cd8b2366857cb76b507ad. 2023-09-27 14:02:53,288 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695823373243.3e9e4d8f614cd8b2366857cb76b507ad. after waiting 0 ms 2023-09-27 14:02:53,288 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695823373243.3e9e4d8f614cd8b2366857cb76b507ad. 2023-09-27 14:02:53,288 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695823373243.3e9e4d8f614cd8b2366857cb76b507ad. 2023-09-27 14:02:53,288 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 3e9e4d8f614cd8b2366857cb76b507ad: 2023-09-27 14:02:53,290 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-09-27 14:02:53,291 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695823373243.16f8da04aeb68a4a0bff66ba155bf84b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695823373291"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695823373291"}]},"ts":"1695823373291"} 2023-09-27 14:02:53,291 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695823373243.3e9e4d8f614cd8b2366857cb76b507ad.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695823373291"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695823373291"}]},"ts":"1695823373291"} 2023-09-27 14:02:53,293 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-27 14:02:53,294 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-27 14:02:53,294 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695823373294"}]},"ts":"1695823373294"} 2023-09-27 14:02:53,295 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-09-27 14:02:53,299 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-09-27 14:02:53,300 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 14:02:53,300 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 14:02:53,300 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 14:02:53,300 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 14:02:53,300 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=3e9e4d8f614cd8b2366857cb76b507ad, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=16f8da04aeb68a4a0bff66ba155bf84b, ASSIGN}] 2023-09-27 14:02:53,303 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=3e9e4d8f614cd8b2366857cb76b507ad, ASSIGN 2023-09-27 14:02:53,303 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=16f8da04aeb68a4a0bff66ba155bf84b, ASSIGN 2023-09-27 14:02:53,303 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=3e9e4d8f614cd8b2366857cb76b507ad, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,43797,1695823272608; forceNewPlan=false, retain=false 2023-09-27 14:02:53,304 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=16f8da04aeb68a4a0bff66ba155bf84b, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,33659,1695823272661; forceNewPlan=false, retain=false 2023-09-27 14:02:53,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-27 14:02:53,454 INFO [jenkins-hbase9:32789] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-27 14:02:53,456 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=3e9e4d8f614cd8b2366857cb76b507ad, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:53,456 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=16f8da04aeb68a4a0bff66ba155bf84b, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:53,457 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695823373243.3e9e4d8f614cd8b2366857cb76b507ad.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695823373456"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695823373456"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695823373456"}]},"ts":"1695823373456"} 2023-09-27 14:02:53,457 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695823373243.16f8da04aeb68a4a0bff66ba155bf84b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695823373456"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695823373456"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695823373456"}]},"ts":"1695823373456"} 2023-09-27 14:02:53,458 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 3e9e4d8f614cd8b2366857cb76b507ad, server=jenkins-hbase9.apache.org,43797,1695823272608}] 2023-09-27 14:02:53,459 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 16f8da04aeb68a4a0bff66ba155bf84b, server=jenkins-hbase9.apache.org,33659,1695823272661}] 2023-09-27 14:02:53,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-27 14:02:53,615 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1695823373243.3e9e4d8f614cd8b2366857cb76b507ad. 2023-09-27 14:02:53,615 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1695823373243.16f8da04aeb68a4a0bff66ba155bf84b. 2023-09-27 14:02:53,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3e9e4d8f614cd8b2366857cb76b507ad, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695823373243.3e9e4d8f614cd8b2366857cb76b507ad.', STARTKEY => '', ENDKEY => '1'} 2023-09-27 14:02:53,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 16f8da04aeb68a4a0bff66ba155bf84b, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695823373243.16f8da04aeb68a4a0bff66ba155bf84b.', STARTKEY => '1', ENDKEY => ''} 2023-09-27 14:02:53,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1695823373243.3e9e4d8f614cd8b2366857cb76b507ad. service=AccessControlService 2023-09-27 14:02:53,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1695823373243.16f8da04aeb68a4a0bff66ba155bf84b. service=AccessControlService 2023-09-27 14:02:53,615 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 14:02:53,615 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 14:02:53,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 3e9e4d8f614cd8b2366857cb76b507ad 2023-09-27 14:02:53,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695823373243.3e9e4d8f614cd8b2366857cb76b507ad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 14:02:53,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 16f8da04aeb68a4a0bff66ba155bf84b 2023-09-27 14:02:53,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 3e9e4d8f614cd8b2366857cb76b507ad 2023-09-27 14:02:53,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695823373243.16f8da04aeb68a4a0bff66ba155bf84b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 14:02:53,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 3e9e4d8f614cd8b2366857cb76b507ad 2023-09-27 14:02:53,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 16f8da04aeb68a4a0bff66ba155bf84b 2023-09-27 14:02:53,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 16f8da04aeb68a4a0bff66ba155bf84b 2023-09-27 14:02:53,617 INFO [StoreOpener-3e9e4d8f614cd8b2366857cb76b507ad-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3e9e4d8f614cd8b2366857cb76b507ad 2023-09-27 14:02:53,617 INFO [StoreOpener-16f8da04aeb68a4a0bff66ba155bf84b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 16f8da04aeb68a4a0bff66ba155bf84b 2023-09-27 14:02:53,618 DEBUG [StoreOpener-3e9e4d8f614cd8b2366857cb76b507ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithSkipTmp/3e9e4d8f614cd8b2366857cb76b507ad/cf 2023-09-27 14:02:53,618 DEBUG [StoreOpener-16f8da04aeb68a4a0bff66ba155bf84b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithSkipTmp/16f8da04aeb68a4a0bff66ba155bf84b/cf 2023-09-27 14:02:53,618 DEBUG [StoreOpener-16f8da04aeb68a4a0bff66ba155bf84b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithSkipTmp/16f8da04aeb68a4a0bff66ba155bf84b/cf 2023-09-27 14:02:53,618 DEBUG [StoreOpener-3e9e4d8f614cd8b2366857cb76b507ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithSkipTmp/3e9e4d8f614cd8b2366857cb76b507ad/cf 2023-09-27 14:02:53,619 INFO [StoreOpener-3e9e4d8f614cd8b2366857cb76b507ad-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3e9e4d8f614cd8b2366857cb76b507ad columnFamilyName cf 2023-09-27 14:02:53,619 INFO [StoreOpener-16f8da04aeb68a4a0bff66ba155bf84b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 16f8da04aeb68a4a0bff66ba155bf84b columnFamilyName cf 2023-09-27 14:02:53,620 INFO [StoreOpener-16f8da04aeb68a4a0bff66ba155bf84b-1] regionserver.HStore(310): Store=16f8da04aeb68a4a0bff66ba155bf84b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 14:02:53,620 INFO [StoreOpener-3e9e4d8f614cd8b2366857cb76b507ad-1] regionserver.HStore(310): Store=3e9e4d8f614cd8b2366857cb76b507ad/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 14:02:53,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithSkipTmp/16f8da04aeb68a4a0bff66ba155bf84b 2023-09-27 14:02:53,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithSkipTmp/3e9e4d8f614cd8b2366857cb76b507ad 2023-09-27 14:02:53,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithSkipTmp/16f8da04aeb68a4a0bff66ba155bf84b 2023-09-27 14:02:53,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithSkipTmp/3e9e4d8f614cd8b2366857cb76b507ad 2023-09-27 14:02:53,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 16f8da04aeb68a4a0bff66ba155bf84b 2023-09-27 14:02:53,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 3e9e4d8f614cd8b2366857cb76b507ad 2023-09-27 14:02:53,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithSkipTmp/16f8da04aeb68a4a0bff66ba155bf84b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 14:02:53,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithSkipTmp/3e9e4d8f614cd8b2366857cb76b507ad/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 14:02:53,626 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 16f8da04aeb68a4a0bff66ba155bf84b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70327588, jitterRate=0.047962725162506104}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 14:02:53,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 16f8da04aeb68a4a0bff66ba155bf84b: 2023-09-27 14:02:53,626 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 3e9e4d8f614cd8b2366857cb76b507ad; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61353777, jitterRate=-0.08575747907161713}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 14:02:53,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 3e9e4d8f614cd8b2366857cb76b507ad: 2023-09-27 14:02:53,627 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1695823373243.3e9e4d8f614cd8b2366857cb76b507ad., pid=108, masterSystemTime=1695823373610 2023-09-27 14:02:53,627 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1695823373243.16f8da04aeb68a4a0bff66ba155bf84b., pid=109, masterSystemTime=1695823373610 2023-09-27 14:02:53,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1695823373243.3e9e4d8f614cd8b2366857cb76b507ad. 2023-09-27 14:02:53,628 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1695823373243.3e9e4d8f614cd8b2366857cb76b507ad. 2023-09-27 14:02:53,629 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=3e9e4d8f614cd8b2366857cb76b507ad, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:53,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1695823373243.16f8da04aeb68a4a0bff66ba155bf84b. 2023-09-27 14:02:53,629 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695823373243.3e9e4d8f614cd8b2366857cb76b507ad.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695823373629"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695823373629"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695823373629"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695823373629"}]},"ts":"1695823373629"} 2023-09-27 14:02:53,629 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1695823373243.16f8da04aeb68a4a0bff66ba155bf84b. 2023-09-27 14:02:53,629 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=16f8da04aeb68a4a0bff66ba155bf84b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:53,629 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695823373243.16f8da04aeb68a4a0bff66ba155bf84b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695823373629"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695823373629"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695823373629"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695823373629"}]},"ts":"1695823373629"} 2023-09-27 14:02:53,632 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=106 2023-09-27 14:02:53,632 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 3e9e4d8f614cd8b2366857cb76b507ad, server=jenkins-hbase9.apache.org,43797,1695823272608 in 173 msec 2023-09-27 14:02:53,632 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-09-27 14:02:53,633 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 16f8da04aeb68a4a0bff66ba155bf84b, server=jenkins-hbase9.apache.org,33659,1695823272661 in 172 msec 2023-09-27 14:02:53,633 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=3e9e4d8f614cd8b2366857cb76b507ad, ASSIGN in 332 msec 2023-09-27 14:02:53,634 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=107, resume processing ppid=105 2023-09-27 14:02:53,634 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=16f8da04aeb68a4a0bff66ba155bf84b, ASSIGN in 333 msec 2023-09-27 14:02:53,634 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-27 14:02:53,635 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695823373634"}]},"ts":"1695823373634"} 2023-09-27 14:02:53,636 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-09-27 14:02:53,638 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-09-27 14:02:53,638 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-09-27 14:02:53,640 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44379] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-27 14:02:53,642 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:02:53,642 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:02:53,642 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:02:53,642 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:02:53,644 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-27 14:02:53,644 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-27 14:02:53,644 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-27 14:02:53,644 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-27 14:02:53,645 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 400 msec 2023-09-27 14:02:53,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-27 14:02:53,852 INFO [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-09-27 14:02:53,854 DEBUG [Listener at jenkins-hbase9.apache.org/33737] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,854 DEBUG [Listener at jenkins-hbase9.apache.org/33737] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695823373243.3e9e4d8f614cd8b2366857cb76b507ad. 2023-09-27 14:02:53,856 INFO [Listener at jenkins-hbase9.apache.org/33737] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 14:02:53,866 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-27 14:02:53,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695823373866 (current time:1695823373866). 2023-09-27 14:02:53,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 14:02:53,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(139): Connect 0x3bf52f43 to 127.0.0.1:60071 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 14:02:53,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@744c34a8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 14:02:53,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 14:02:53,883 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52200, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 14:02:53,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3bf52f43 to 127.0.0.1:60071 2023-09-27 14:02:53,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 14:02:53,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(139): Connect 0x04db7fb9 to 127.0.0.1:60071 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 14:02:53,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@16c6d756, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 14:02:53,899 DEBUG [hconnection-0x33a4852-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 14:02:53,902 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52204, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 14:02:53,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 14:02:53,909 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:41222, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 14:02:53,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x04db7fb9 to 127.0.0.1:60071 2023-09-27 14:02:53,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 14:02:53,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-27 14:02:53,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 14:02:53,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-27 14:02:53,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-27 14:02:53,914 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-27 14:02:53,915 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695823973915 2023-09-27 14:02:53,915 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-27 14:02:53,916 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 14:02:53,916 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 14:02:53,917 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-27 14:02:53,917 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-27 14:02:53,918 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-09-27 14:02:53,919 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-27 14:02:53,920 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695823973920 2023-09-27 14:02:53,932 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,932 INFO [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-27 14:02:53,932 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:02:53,934 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-27 14:02:53,934 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-27 14:02:53,934 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,934 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,935 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:02:53,935 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:02:53,935 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:53,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:02:53,935 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:02:53,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:02:53,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:02:53,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:02:53,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:02:53,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:02:53,936 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:53,936 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:53,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,936 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:53,936 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 14:02:53,936 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,936 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,936 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-27 14:02:53,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-27 14:02:53,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-27 14:02:53,937 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-27 14:02:53,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,937 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-27 14:02:53,937 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-27 14:02:53,937 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,937 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,937 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-27 14:02:53,937 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-27 14:02:53,937 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:02:53,937 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:02:53,939 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-27 14:02:53,939 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,939 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-27 14:02:53,939 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44379,1695823272702' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-27 14:02:53,939 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-27 14:02:53,939 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-27 14:02:53,939 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,43797,1695823272608' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-27 14:02:53,939 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-27 14:02:53,939 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:02:53,940 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-27 14:02:53,940 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-27 14:02:53,940 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33659,1695823272661' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-27 14:02:53,947 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,948 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:53,948 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:53,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:02:53,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:02:53,948 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:53,948 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,948 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,948 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 14:02:53,948 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,948 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 14:02:53,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:02:53,948 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,948 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 14:02:53,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:02:53,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:53,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:53,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:53,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:02:53,950 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,43797,1695823272608' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-27 14:02:53,950 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f87357f[Count = 1] remaining members to acquire global barrier 2023-09-27 14:02:53,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:53,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:02:53,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:02:53,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:02:53,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:02:53,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:53,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:53,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:53,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:02:53,952 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,33659,1695823272661' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-27 14:02:53,952 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f87357f[Count = 0] remaining members to acquire global barrier 2023-09-27 14:02:53,952 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-27 14:02:53,952 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,953 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,953 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,953 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-27 14:02:53,953 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-27 14:02:53,953 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,953 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:53,953 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-27 14:02:53,953 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695823373243.3e9e4d8f614cd8b2366857cb76b507ad. 2023-09-27 14:02:53,953 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 14:02:53,953 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695823373243.3e9e4d8f614cd8b2366857cb76b507ad. started... 2023-09-27 14:02:53,953 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 14:02:53,953 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 14:02:53,954 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 14:02:53,954 DEBUG [rs(jenkins-hbase9.apache.org,33659,1695823272661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695823373243.16f8da04aeb68a4a0bff66ba155bf84b. 2023-09-27 14:02:53,953 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-27 14:02:53,954 DEBUG [rs(jenkins-hbase9.apache.org,33659,1695823272661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695823373243.16f8da04aeb68a4a0bff66ba155bf84b. started... 2023-09-27 14:02:53,954 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,44379,1695823272702' in zk 2023-09-27 14:02:53,954 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3e9e4d8f614cd8b2366857cb76b507ad: 2023-09-27 14:02:53,954 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:53,955 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 14:02:53,955 DEBUG [rs(jenkins-hbase9.apache.org,33659,1695823272661)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 16f8da04aeb68a4a0bff66ba155bf84b: 2023-09-27 14:02:53,955 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695823373243.3e9e4d8f614cd8b2366857cb76b507ad.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,956 DEBUG [rs(jenkins-hbase9.apache.org,33659,1695823272661)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695823373243.16f8da04aeb68a4a0bff66ba155bf84b.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,956 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 14:02:53,956 DEBUG [rs(jenkins-hbase9.apache.org,33659,1695823272661)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 14:02:53,956 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 14:02:53,956 DEBUG [rs(jenkins-hbase9.apache.org,33659,1695823272661)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 14:02:53,957 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-27 14:02:53,957 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:02:53,957 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-27 14:02:53,975 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695823373243.3e9e4d8f614cd8b2366857cb76b507ad. completed. 2023-09-27 14:02:53,975 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695823373243.3e9e4d8f614cd8b2366857cb76b507ad. 2023-09-27 14:02:53,975 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 14:02:53,976 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 14:02:53,976 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:53,976 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-27 14:02:53,976 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,43797,1695823272608' in zk 2023-09-27 14:02:53,976 DEBUG [rs(jenkins-hbase9.apache.org,33659,1695823272661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695823373243.16f8da04aeb68a4a0bff66ba155bf84b. completed. 2023-09-27 14:02:53,976 DEBUG [rs(jenkins-hbase9.apache.org,33659,1695823272661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695823373243.16f8da04aeb68a4a0bff66ba155bf84b. 2023-09-27 14:02:53,976 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 14:02:53,976 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 14:02:53,976 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:53,976 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-27 14:02:53,976 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,33659,1695823272661' in zk 2023-09-27 14:02:53,982 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-27 14:02:53,982 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:53,982 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:02:53,982 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-27 14:02:53,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:53,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:02:53,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:02:53,984 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:53,984 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-27 14:02:53,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:02:53,984 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:02:53,984 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-27 14:02:53,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:02:53,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:53,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:53,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:53,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:02:53,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:53,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:53,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:53,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,43797,1695823272608': 2023-09-27 14:02:53,989 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,43797,1695823272608' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-27 14:02:53,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:53,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:02:53,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:02:53,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:02:53,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:02:53,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:53,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:53,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:53,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:02:53,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:53,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:53,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:53,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,33659,1695823272661': 2023-09-27 14:02:53,992 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,33659,1695823272661' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-27 14:02:53,992 INFO [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-27 14:02:53,992 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 14:02:53,992 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 14:02:53,993 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,993 INFO [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 14:02:53,994 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,994 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:02:53,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:02:53,994 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:02:53,994 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,994 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,994 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:02:53,994 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:02:53,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:02:53,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:02:53,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:02:53,995 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:53,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:02:53,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:02:53,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:02:53,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:02:53,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:02:53,995 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:53,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,996 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:53,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:53,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:53,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:53,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:02:53,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:53,997 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:53,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:53,998 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:53,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:53,998 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:53,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:54,000 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:54,000 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:02:54,000 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,001 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:02:54,001 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,001 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:02:54,002 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:02:54,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:02:54,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:02:54,001 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:02:54,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:02:54,002 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:02:54,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:02:54,002 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:02:54,002 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,001 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:54,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:02:54,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:02:54,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:02:54,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:02:54,003 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,003 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:54,003 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 14:02:54,003 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:02:54,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:02:54,003 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:54,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:02:54,003 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:02:54,003 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:54,003 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:54,003 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,003 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,004 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-27 14:02:54,014 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,014 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,016 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 14:02:54,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-27 14:02:54,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-27 14:02:54,018 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 14:02:54,030 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,031 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-27 14:02:54,031 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,032 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,032 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695823373915Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695823374014 (+99 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695823374014Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695823374014Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695823374017 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695823374024 (+7 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695823374031 (+7 ms) 2023-09-27 14:02:54,035 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-27 14:02:54,037 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 119 msec 2023-09-27 14:02:54,218 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 14:02:54,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-27 14:02:54,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 14:02:54,221 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43797] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1695823373243.3e9e4d8f614cd8b2366857cb76b507ad. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 14:02:54,222 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33659] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1695823373243.16f8da04aeb68a4a0bff66ba155bf84b. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 14:02:54,225 DEBUG [Listener at jenkins-hbase9.apache.org/33737] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,225 DEBUG [Listener at jenkins-hbase9.apache.org/33737] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695823373243.3e9e4d8f614cd8b2366857cb76b507ad. 2023-09-27 14:02:54,225 INFO [Listener at jenkins-hbase9.apache.org/33737] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 14:02:54,235 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-27 14:02:54,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695823374235 (current time:1695823374235). 2023-09-27 14:02:54,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 14:02:54,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(139): Connect 0x5eb8a450 to 127.0.0.1:60071 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 14:02:54,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f110f0d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 14:02:54,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 14:02:54,246 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52206, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 14:02:54,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5eb8a450 to 127.0.0.1:60071 2023-09-27 14:02:54,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 14:02:54,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(139): Connect 0x1c52bb42 to 127.0.0.1:60071 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 14:02:54,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@75306bc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 14:02:54,255 DEBUG [hconnection-0x3d183c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 14:02:54,259 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52210, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 14:02:54,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 14:02:54,266 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:41228, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 14:02:54,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c52bb42 to 127.0.0.1:60071 2023-09-27 14:02:54,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 14:02:54,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-27 14:02:54,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 14:02:54,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-27 14:02:54,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-27 14:02:54,271 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-27 14:02:54,272 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695823974272 2023-09-27 14:02:54,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-27 14:02:54,272 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,273 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 14:02:54,274 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 14:02:54,275 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-27 14:02:54,275 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-27 14:02:54,276 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-09-27 14:02:54,277 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-27 14:02:54,277 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695823974277 2023-09-27 14:02:54,287 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,287 INFO [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-27 14:02:54,287 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:02:54,288 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-27 14:02:54,288 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-27 14:02:54,289 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,289 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,291 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:02:54,291 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:02:54,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:02:54,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:02:54,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:02:54,291 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:54,291 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:02:54,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:02:54,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:02:54,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:02:54,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,292 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:54,292 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:54,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,292 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,292 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:54,292 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 14:02:54,292 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-27 14:02:54,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,292 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,293 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-27 14:02:54,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-27 14:02:54,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,293 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,293 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-27 14:02:54,293 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-27 14:02:54,293 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:02:54,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-27 14:02:54,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,293 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,295 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-27 14:02:54,295 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-27 14:02:54,295 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33659,1695823272661' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-27 14:02:54,295 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-27 14:02:54,295 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:02:54,295 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-27 14:02:54,296 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-27 14:02:54,296 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-27 14:02:54,296 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44379,1695823272702' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-27 14:02:54,296 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,296 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-27 14:02:54,296 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 14:02:54,297 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-27 14:02:54,297 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-27 14:02:54,297 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,43797,1695823272608' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-27 14:02:54,299 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:54,299 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:54,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:02:54,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:02:54,299 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,299 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:02:54,299 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,299 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:54,299 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 14:02:54,300 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,300 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 14:02:54,300 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,300 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 14:02:54,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:02:54,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:54,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:54,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:54,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:02:54,301 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,33659,1695823272661' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-27 14:02:54,301 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63ab20bc[Count = 1] remaining members to acquire global barrier 2023-09-27 14:02:54,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:54,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:02:54,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:02:54,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:02:54,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:02:54,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:54,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:54,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:54,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:02:54,303 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,43797,1695823272608' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-27 14:02:54,303 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63ab20bc[Count = 0] remaining members to acquire global barrier 2023-09-27 14:02:54,303 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-27 14:02:54,303 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,308 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,308 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,308 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,308 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-27 14:02:54,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,308 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-27 14:02:54,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,308 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-27 14:02:54,308 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-27 14:02:54,308 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:54,308 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 14:02:54,308 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 14:02:54,308 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,44379,1695823272702' in zk 2023-09-27 14:02:54,309 DEBUG [rs(jenkins-hbase9.apache.org,33659,1695823272661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695823373243.16f8da04aeb68a4a0bff66ba155bf84b. 2023-09-27 14:02:54,309 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695823373243.3e9e4d8f614cd8b2366857cb76b507ad. 2023-09-27 14:02:54,309 DEBUG [rs(jenkins-hbase9.apache.org,33659,1695823272661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695823373243.16f8da04aeb68a4a0bff66ba155bf84b. started... 2023-09-27 14:02:54,309 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 14:02:54,309 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:54,309 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695823373243.3e9e4d8f614cd8b2366857cb76b507ad. started... 2023-09-27 14:02:54,309 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 14:02:54,309 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 14:02:54,309 INFO [rs(jenkins-hbase9.apache.org,33659,1695823272661)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 16f8da04aeb68a4a0bff66ba155bf84b 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-27 14:02:54,309 INFO [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3e9e4d8f614cd8b2366857cb76b507ad 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-27 14:02:54,310 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-27 14:02:54,310 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:02:54,310 DEBUG [member: 'jenkins-hbase9.apache.org,44379,1695823272702' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-27 14:02:54,326 INFO [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230927d4266a27bc0a4578bc6d9915700cf26d to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230927d4266a27bc0a4578bc6d9915700cf26d 2023-09-27 14:02:54,331 INFO [rs(jenkins-hbase9.apache.org,33659,1695823272661)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230927984665508be84d519578993dcaa1b9d7 to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230927984665508be84d519578993dcaa1b9d7 2023-09-27 14:02:54,343 INFO [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithSkipTmp/3e9e4d8f614cd8b2366857cb76b507ad/.tmp/cf/ef2f9398a77b461ca5c01ab1129c0f7b 2023-09-27 14:02:54,344 INFO [rs(jenkins-hbase9.apache.org,33659,1695823272661)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithSkipTmp/16f8da04aeb68a4a0bff66ba155bf84b/.tmp/cf/28c7026a5aec484d963dc82426688ce7 2023-09-27 14:02:54,350 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithSkipTmp/3e9e4d8f614cd8b2366857cb76b507ad/.tmp/cf/ef2f9398a77b461ca5c01ab1129c0f7b as hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithSkipTmp/3e9e4d8f614cd8b2366857cb76b507ad/cf/ef2f9398a77b461ca5c01ab1129c0f7b 2023-09-27 14:02:54,351 DEBUG [rs(jenkins-hbase9.apache.org,33659,1695823272661)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithSkipTmp/16f8da04aeb68a4a0bff66ba155bf84b/.tmp/cf/28c7026a5aec484d963dc82426688ce7 as hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithSkipTmp/16f8da04aeb68a4a0bff66ba155bf84b/cf/28c7026a5aec484d963dc82426688ce7 2023-09-27 14:02:54,355 INFO [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithSkipTmp/3e9e4d8f614cd8b2366857cb76b507ad/cf/ef2f9398a77b461ca5c01ab1129c0f7b, entries=2, sequenceid=6, filesize=5.2 K 2023-09-27 14:02:54,355 INFO [rs(jenkins-hbase9.apache.org,33659,1695823272661)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithSkipTmp/16f8da04aeb68a4a0bff66ba155bf84b/cf/28c7026a5aec484d963dc82426688ce7, entries=48, sequenceid=6, filesize=13.5 K 2023-09-27 14:02:54,355 INFO [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 3e9e4d8f614cd8b2366857cb76b507ad in 46ms, sequenceid=6, compaction requested=false 2023-09-27 14:02:54,356 INFO [rs(jenkins-hbase9.apache.org,33659,1695823272661)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 16f8da04aeb68a4a0bff66ba155bf84b in 46ms, sequenceid=6, compaction requested=false 2023-09-27 14:02:54,356 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-27 14:02:54,356 DEBUG [rs(jenkins-hbase9.apache.org,33659,1695823272661)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-27 14:02:54,359 DEBUG [rs(jenkins-hbase9.apache.org,33659,1695823272661)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 16f8da04aeb68a4a0bff66ba155bf84b: 2023-09-27 14:02:54,359 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3e9e4d8f614cd8b2366857cb76b507ad: 2023-09-27 14:02:54,359 DEBUG [rs(jenkins-hbase9.apache.org,33659,1695823272661)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695823373243.16f8da04aeb68a4a0bff66ba155bf84b.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,359 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695823373243.3e9e4d8f614cd8b2366857cb76b507ad.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,359 DEBUG [rs(jenkins-hbase9.apache.org,33659,1695823272661)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 14:02:54,359 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 14:02:54,359 DEBUG [rs(jenkins-hbase9.apache.org,33659,1695823272661)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithSkipTmp/16f8da04aeb68a4a0bff66ba155bf84b/cf/28c7026a5aec484d963dc82426688ce7] hfiles 2023-09-27 14:02:54,359 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithSkipTmp/3e9e4d8f614cd8b2366857cb76b507ad/cf/ef2f9398a77b461ca5c01ab1129c0f7b] hfiles 2023-09-27 14:02:54,359 DEBUG [rs(jenkins-hbase9.apache.org,33659,1695823272661)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithSkipTmp/16f8da04aeb68a4a0bff66ba155bf84b/cf/28c7026a5aec484d963dc82426688ce7 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,359 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithSkipTmp/3e9e4d8f614cd8b2366857cb76b507ad/cf/ef2f9398a77b461ca5c01ab1129c0f7b for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,366 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695823373243.3e9e4d8f614cd8b2366857cb76b507ad. completed. 2023-09-27 14:02:54,366 DEBUG [rs(jenkins-hbase9.apache.org,43797,1695823272608)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695823373243.3e9e4d8f614cd8b2366857cb76b507ad. 2023-09-27 14:02:54,366 DEBUG [rs(jenkins-hbase9.apache.org,33659,1695823272661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695823373243.16f8da04aeb68a4a0bff66ba155bf84b. completed. 2023-09-27 14:02:54,366 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 14:02:54,366 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 14:02:54,366 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:54,366 DEBUG [rs(jenkins-hbase9.apache.org,33659,1695823272661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695823373243.16f8da04aeb68a4a0bff66ba155bf84b. 2023-09-27 14:02:54,367 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-27 14:02:54,367 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,43797,1695823272608' in zk 2023-09-27 14:02:54,367 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 14:02:54,367 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 14:02:54,367 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:54,367 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-27 14:02:54,367 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,33659,1695823272661' in zk 2023-09-27 14:02:54,368 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-27 14:02:54,368 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:54,368 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-27 14:02:54,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:54,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:02:54,368 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:02:54,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:02:54,368 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:54,368 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:02:54,368 DEBUG [member: 'jenkins-hbase9.apache.org,33659,1695823272661' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-27 14:02:54,370 DEBUG [member: 'jenkins-hbase9.apache.org,43797,1695823272608' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-27 14:02:54,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:02:54,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:02:54,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:54,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:54,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:54,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:02:54,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,374 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 14:02:54,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:54,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:54,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:54,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-27 14:02:54,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-27 14:02:54,375 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 14:02:54,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,43797,1695823272608': 2023-09-27 14:02:54,375 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,43797,1695823272608' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-27 14:02:54,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:54,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:02:54,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:02:54,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:02:54,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:02:54,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:54,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:54,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:54,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:02:54,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:54,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:54,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:54,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,33659,1695823272661': 2023-09-27 14:02:54,378 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,33659,1695823272661' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-27 14:02:54,378 INFO [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-27 14:02:54,378 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 14:02:54,378 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 14:02:54,378 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,378 INFO [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 14:02:54,380 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,380 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,380 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:02:54,380 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:02:54,380 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,380 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 14:02:54,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 14:02:54,381 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:54,380 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:02:54,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:02:54,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:02:54,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:02:54,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:02:54,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:02:54,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:02:54,381 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:54,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 14:02:54,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,382 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:54,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 14:02:54,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:54,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:54,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:54,383 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:54,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 14:02:54,383 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:54,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,383 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:54,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:54,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:54,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:54,387 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:54,387 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:02:54,387 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,387 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:54,387 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:02:54,387 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:54,387 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:02:54,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:02:54,387 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:02:54,387 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,387 DEBUG [(jenkins-hbase9.apache.org,32789,1695823271327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 14:02:54,387 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,387 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:02:54,387 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 14:02:54,387 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:02:54,387 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:02:54,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:02:54,389 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 14:02:54,389 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,389 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 14:02:54,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 14:02:54,389 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:02:54,389 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:02:54,390 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,390 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 14:02:54,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:02:54,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:02:54,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:02:54,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:02:54,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 14:02:54,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 14:02:54,390 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230927984665508be84d519578993dcaa1b9d7, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230927d4266a27bc0a4578bc6d9915700cf26d] mob files 2023-09-27 14:02:54,390 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230927984665508be84d519578993dcaa1b9d7 2023-09-27 14:02:54,390 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230927d4266a27bc0a4578bc6d9915700cf26d 2023-09-27 14:02:54,397 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,397 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,415 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,415 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-27 14:02:54,416 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,416 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,416 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695823374272Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695823374397 (+125 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695823374397Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1695823374397Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1695823374400 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695823374409 (+9 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695823374415 (+6 ms) 2023-09-27 14:02:54,419 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-27 14:02:54,420 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 146 msec 2023-09-27 14:02:54,575 DEBUG [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 14:02:54,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-27 14:02:54,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 14:02:54,576 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823374576 2023-09-27 14:02:54,577 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:46363, tgtDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823374576, rawTgtDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823374576, srcFsUri=hdfs://localhost:46363, srcDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30 2023-09-27 14:02:54,609 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:46363, inputRoot=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30 2023-09-27 14:02:54,609 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-532854352_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823374576, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823374576/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,609 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:46363, inputRoot=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30, snapshotDir=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-09-27 14:02:54,620 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823374576/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:02:54,635 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-27 14:02:54,635 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-27 14:02:54,635 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-27 14:02:54,636 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-27 14:02:55,510 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/hadoop-4766431759603212931.jar 2023-09-27 14:02:55,511 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-27 14:02:55,511 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-27 14:02:55,579 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/hadoop-2493379077304502224.jar 2023-09-27 14:02:55,579 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-27 14:02:55,580 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-27 14:02:55,580 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-27 14:02:55,581 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-27 14:02:55,581 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-27 14:02:55,581 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-27 14:02:55,582 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-27 14:02:55,582 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-27 14:02:55,583 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-27 14:02:55,583 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-27 14:02:55,583 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-27 14:02:55,584 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-27 14:02:55,584 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-27 14:02:55,584 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-27 14:02:55,585 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-27 14:02:55,585 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-27 14:02:55,586 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 14:02:55,586 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 14:02:55,587 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 14:02:55,587 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 14:02:55,587 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 14:02:55,588 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 14:02:55,588 DEBUG [Listener at jenkins-hbase9.apache.org/33737] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 14:02:55,926 WARN [Listener at jenkins-hbase9.apache.org/33737] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-27 14:02:55,928 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-09-27 14:02:55,929 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-09-27 14:02:57,740 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 14:02:57,740 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 14:02:57,743 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695823279135_0006_000001 (auth:SIMPLE) 2023-09-27 14:02:58,068 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695823279135_0007_000001 (auth:SIMPLE) 2023-09-27 14:02:58,512 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-27 14:03:01,865 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695823279135_0007_000001 (auth:SIMPLE) 2023-09-27 14:03:04,084 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695823279135_0007_000001 (auth:SIMPLE) 2023-09-27 14:03:06,647 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695823279135_0007_000001 (auth:SIMPLE) 2023-09-27 14:03:08,097 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-27 14:03:08,097 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-27 14:03:08,108 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:03:08,109 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-27 14:03:08,109 INFO [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-27 14:03:08,109 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1724413351_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:03:08,110 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(367): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-27 14:03:08,110 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(367): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-27 14:03:08,110 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1724413351_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823374576/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823374576/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:03:08,110 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(367): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823374576/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-27 14:03:08,110 DEBUG [Listener at jenkins-hbase9.apache.org/33737] snapshot.TestExportSnapshot(367): hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/export-test/export-1695823374576/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-27 14:03:08,116 INFO [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 14:03:08,116 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 14:03:08,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 14:03:08,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-27 14:03:08,120 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695823388120"}]},"ts":"1695823388120"} 2023-09-27 14:03:08,121 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-09-27 14:03:08,124 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-09-27 14:03:08,124 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=3e9e4d8f614cd8b2366857cb76b507ad, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=16f8da04aeb68a4a0bff66ba155bf84b, UNASSIGN}] 2023-09-27 14:03:08,127 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=3e9e4d8f614cd8b2366857cb76b507ad, UNASSIGN 2023-09-27 14:03:08,127 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=16f8da04aeb68a4a0bff66ba155bf84b, UNASSIGN 2023-09-27 14:03:08,127 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=3e9e4d8f614cd8b2366857cb76b507ad, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:03:08,127 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=16f8da04aeb68a4a0bff66ba155bf84b, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:03:08,127 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695823373243.3e9e4d8f614cd8b2366857cb76b507ad.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695823388127"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695823388127"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695823388127"}]},"ts":"1695823388127"} 2023-09-27 14:03:08,127 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695823373243.16f8da04aeb68a4a0bff66ba155bf84b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695823388127"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695823388127"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695823388127"}]},"ts":"1695823388127"} 2023-09-27 14:03:08,129 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 3e9e4d8f614cd8b2366857cb76b507ad, server=jenkins-hbase9.apache.org,43797,1695823272608}] 2023-09-27 14:03:08,129 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 16f8da04aeb68a4a0bff66ba155bf84b, server=jenkins-hbase9.apache.org,33659,1695823272661}] 2023-09-27 14:03:08,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-27 14:03:08,281 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 3e9e4d8f614cd8b2366857cb76b507ad 2023-09-27 14:03:08,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 3e9e4d8f614cd8b2366857cb76b507ad, disabling compactions & flushes 2023-09-27 14:03:08,281 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695823373243.3e9e4d8f614cd8b2366857cb76b507ad. 2023-09-27 14:03:08,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695823373243.3e9e4d8f614cd8b2366857cb76b507ad. 2023-09-27 14:03:08,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695823373243.3e9e4d8f614cd8b2366857cb76b507ad. after waiting 0 ms 2023-09-27 14:03:08,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695823373243.3e9e4d8f614cd8b2366857cb76b507ad. 2023-09-27 14:03:08,285 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 16f8da04aeb68a4a0bff66ba155bf84b 2023-09-27 14:03:08,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 16f8da04aeb68a4a0bff66ba155bf84b, disabling compactions & flushes 2023-09-27 14:03:08,285 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695823373243.16f8da04aeb68a4a0bff66ba155bf84b. 2023-09-27 14:03:08,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695823373243.16f8da04aeb68a4a0bff66ba155bf84b. 2023-09-27 14:03:08,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695823373243.16f8da04aeb68a4a0bff66ba155bf84b. after waiting 0 ms 2023-09-27 14:03:08,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695823373243.16f8da04aeb68a4a0bff66ba155bf84b. 2023-09-27 14:03:08,294 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithSkipTmp/3e9e4d8f614cd8b2366857cb76b507ad/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 14:03:08,294 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/default/testtb-testExportFileSystemStateWithSkipTmp/16f8da04aeb68a4a0bff66ba155bf84b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 14:03:08,294 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 14:03:08,295 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695823373243.3e9e4d8f614cd8b2366857cb76b507ad. 2023-09-27 14:03:08,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 3e9e4d8f614cd8b2366857cb76b507ad: 2023-09-27 14:03:08,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 14:03:08,296 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695823373243.16f8da04aeb68a4a0bff66ba155bf84b. 2023-09-27 14:03:08,297 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 16f8da04aeb68a4a0bff66ba155bf84b: 2023-09-27 14:03:08,298 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 3e9e4d8f614cd8b2366857cb76b507ad 2023-09-27 14:03:08,298 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=3e9e4d8f614cd8b2366857cb76b507ad, regionState=CLOSED 2023-09-27 14:03:08,298 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695823373243.3e9e4d8f614cd8b2366857cb76b507ad.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695823388298"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695823388298"}]},"ts":"1695823388298"} 2023-09-27 14:03:08,298 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 16f8da04aeb68a4a0bff66ba155bf84b 2023-09-27 14:03:08,299 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=16f8da04aeb68a4a0bff66ba155bf84b, regionState=CLOSED 2023-09-27 14:03:08,299 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695823373243.16f8da04aeb68a4a0bff66ba155bf84b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695823388299"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695823388299"}]},"ts":"1695823388299"} 2023-09-27 14:03:08,301 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-09-27 14:03:08,301 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 3e9e4d8f614cd8b2366857cb76b507ad, server=jenkins-hbase9.apache.org,43797,1695823272608 in 171 msec 2023-09-27 14:03:08,302 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-09-27 14:03:08,302 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 16f8da04aeb68a4a0bff66ba155bf84b, server=jenkins-hbase9.apache.org,33659,1695823272661 in 171 msec 2023-09-27 14:03:08,303 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=3e9e4d8f614cd8b2366857cb76b507ad, UNASSIGN in 177 msec 2023-09-27 14:03:08,303 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=116, resume processing ppid=114 2023-09-27 14:03:08,304 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=16f8da04aeb68a4a0bff66ba155bf84b, UNASSIGN in 178 msec 2023-09-27 14:03:08,304 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695823388304"}]},"ts":"1695823388304"} 2023-09-27 14:03:08,305 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-09-27 14:03:08,307 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-09-27 14:03:08,308 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 191 msec 2023-09-27 14:03:08,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-27 14:03:08,422 INFO [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-09-27 14:03:08,423 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 14:03:08,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 14:03:08,426 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 14:03:08,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 14:03:08,427 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 14:03:08,428 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44379] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 14:03:08,430 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 14:03:08,430 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 14:03:08,430 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 14:03:08,430 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 14:03:08,431 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3e9e4d8f614cd8b2366857cb76b507ad 2023-09-27 14:03:08,431 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-27 14:03:08,431 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-27 14:03:08,431 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/16f8da04aeb68a4a0bff66ba155bf84b 2023-09-27 14:03:08,431 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-27 14:03:08,431 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-27 14:03:08,433 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3e9e4d8f614cd8b2366857cb76b507ad/cf, FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3e9e4d8f614cd8b2366857cb76b507ad/recovered.edits] 2023-09-27 14:03:08,433 DEBUG [HFileArchiver-16] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/16f8da04aeb68a4a0bff66ba155bf84b/cf, FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/16f8da04aeb68a4a0bff66ba155bf84b/recovered.edits] 2023-09-27 14:03:08,433 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 14:03:08,433 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 14:03:08,433 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 14:03:08,433 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:03:08,433 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 14:03:08,433 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:03:08,433 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:03:08,433 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 14:03:08,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-27 14:03:08,437 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/16f8da04aeb68a4a0bff66ba155bf84b/cf/28c7026a5aec484d963dc82426688ce7 to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/16f8da04aeb68a4a0bff66ba155bf84b/cf/28c7026a5aec484d963dc82426688ce7 2023-09-27 14:03:08,437 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3e9e4d8f614cd8b2366857cb76b507ad/cf/ef2f9398a77b461ca5c01ab1129c0f7b to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/3e9e4d8f614cd8b2366857cb76b507ad/cf/ef2f9398a77b461ca5c01ab1129c0f7b 2023-09-27 14:03:08,440 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/16f8da04aeb68a4a0bff66ba155bf84b/recovered.edits/9.seqid to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/16f8da04aeb68a4a0bff66ba155bf84b/recovered.edits/9.seqid 2023-09-27 14:03:08,440 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3e9e4d8f614cd8b2366857cb76b507ad/recovered.edits/9.seqid to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/3e9e4d8f614cd8b2366857cb76b507ad/recovered.edits/9.seqid 2023-09-27 14:03:08,441 DEBUG [HFileArchiver-16] backup.HFileArchiver(596): Deleted hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/16f8da04aeb68a4a0bff66ba155bf84b 2023-09-27 14:03:08,441 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3e9e4d8f614cd8b2366857cb76b507ad 2023-09-27 14:03:08,441 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-27 14:03:08,441 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-27 14:03:08,442 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-09-27 14:03:08,445 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230927984665508be84d519578993dcaa1b9d7 to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230927984665508be84d519578993dcaa1b9d7 2023-09-27 14:03:08,447 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230927d4266a27bc0a4578bc6d9915700cf26d to hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230927d4266a27bc0a4578bc6d9915700cf26d 2023-09-27 14:03:08,447 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-27 14:03:08,449 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 14:03:08,452 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-09-27 14:03:08,454 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-09-27 14:03:08,455 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 14:03:08,455 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-09-27 14:03:08,455 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695823373243.3e9e4d8f614cd8b2366857cb76b507ad.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695823388455"}]},"ts":"9223372036854775807"} 2023-09-27 14:03:08,455 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695823373243.16f8da04aeb68a4a0bff66ba155bf84b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695823388455"}]},"ts":"9223372036854775807"} 2023-09-27 14:03:08,457 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-27 14:03:08,457 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3e9e4d8f614cd8b2366857cb76b507ad, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695823373243.3e9e4d8f614cd8b2366857cb76b507ad.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 16f8da04aeb68a4a0bff66ba155bf84b, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695823373243.16f8da04aeb68a4a0bff66ba155bf84b.', STARTKEY => '1', ENDKEY => ''}] 2023-09-27 14:03:08,457 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-09-27 14:03:08,457 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695823388457"}]},"ts":"9223372036854775807"} 2023-09-27 14:03:08,458 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-09-27 14:03:08,460 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 14:03:08,461 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 37 msec 2023-09-27 14:03:08,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-27 14:03:08,535 INFO [Listener at jenkins-hbase9.apache.org/33737] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-09-27 14:03:08,542 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-27 14:03:08,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:03:08,545 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-27 14:03:08,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32789] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 14:03:08,574 INFO [Listener at jenkins-hbase9.apache.org/33737] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764 (was 766), OpenFileDescriptor=913 (was 942), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=134 (was 148), ProcessCount=168 (was 170), AvailableMemoryMB=8567 (was 8633) 2023-09-27 14:03:08,574 WARN [Listener at jenkins-hbase9.apache.org/33737] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-09-27 14:03:08,574 INFO [Listener at jenkins-hbase9.apache.org/33737] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-09-27 14:03:08,590 INFO [Listener at jenkins-hbase9.apache.org/33737] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-09-27 14:03:12,823 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695823279135_0007_000001 (auth:SIMPLE) 2023-09-27 14:03:13,867 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-27 14:03:22,714 INFO [Listener at jenkins-hbase9.apache.org/33737] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-09-27 14:03:36,831 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-27 14:03:36,832 INFO [Listener at jenkins-hbase9.apache.org/33737] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-09-27 14:03:36,940 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-09-27 14:03:36,949 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-09-27 14:03:36,950 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-27 14:03:36,961 INFO [Listener at jenkins-hbase9.apache.org/33737] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-09-27 14:03:37,065 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-27 14:03:37,065 INFO [Listener at jenkins-hbase9.apache.org/33737] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-09-27 14:03:37,065 INFO [Listener at jenkins-hbase9.apache.org/33737] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-09-27 14:03:37,065 INFO [Listener at jenkins-hbase9.apache.org/33737] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-09-27 14:03:37,065 DEBUG [Listener at jenkins-hbase9.apache.org/33737] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x627146cd to 127.0.0.1:60071 2023-09-27 14:03:37,065 DEBUG [Listener at jenkins-hbase9.apache.org/33737] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 14:03:37,066 DEBUG [Listener at jenkins-hbase9.apache.org/33737] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-09-27 14:03:37,066 DEBUG [Listener at jenkins-hbase9.apache.org/33737] util.JVMClusterUtil(257): Found active master hash=1497022553, stopped=false 2023-09-27 14:03:37,066 DEBUG [Listener at jenkins-hbase9.apache.org/33737] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 14:03:37,066 DEBUG [Listener at jenkins-hbase9.apache.org/33737] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-27 14:03:37,066 INFO [Listener at jenkins-hbase9.apache.org/33737] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase9.apache.org,32789,1695823271327 2023-09-27 14:03:37,068 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-27 14:03:37,068 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-27 14:03:37,068 INFO [Listener at jenkins-hbase9.apache.org/33737] procedure2.ProcedureExecutor(628): Stopping 2023-09-27 14:03:37,068 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-27 14:03:37,068 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-27 14:03:37,068 DEBUG [Listener at jenkins-hbase9.apache.org/33737] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6f37cb58 to 127.0.0.1:60071 2023-09-27 14:03:37,068 DEBUG [Listener at jenkins-hbase9.apache.org/33737] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 14:03:37,068 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-27 14:03:37,068 INFO [Listener at jenkins-hbase9.apache.org/33737] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,43797,1695823272608' ***** 2023-09-27 14:03:37,068 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 14:03:37,069 DEBUG [Listener at jenkins-hbase9.apache.org/33737] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 14:03:37,069 INFO [Listener at jenkins-hbase9.apache.org/33737] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-27 14:03:37,069 INFO [Listener at jenkins-hbase9.apache.org/33737] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,33659,1695823272661' ***** 2023-09-27 14:03:37,069 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-27 14:03:37,069 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-27 14:03:37,069 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-27 14:03:37,069 DEBUG [Listener at jenkins-hbase9.apache.org/33737] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 14:03:37,069 INFO [Listener at jenkins-hbase9.apache.org/33737] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-27 14:03:37,069 INFO [RS:0;jenkins-hbase9:43797] regionserver.HeapMemoryManager(220): Stopping 2023-09-27 14:03:37,069 INFO [Listener at jenkins-hbase9.apache.org/33737] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,44379,1695823272702' ***** 2023-09-27 14:03:37,070 INFO [RS:0;jenkins-hbase9:43797] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-27 14:03:37,070 DEBUG [Listener at jenkins-hbase9.apache.org/33737] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 14:03:37,070 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-27 14:03:37,070 INFO [RS:0;jenkins-hbase9:43797] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-27 14:03:37,070 INFO [Listener at jenkins-hbase9.apache.org/33737] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-27 14:03:37,070 INFO [RS:0;jenkins-hbase9:43797] regionserver.HRegionServer(3305): Received CLOSE for 1f3d6c533eb0530f04a2c0dae249adc7 2023-09-27 14:03:37,070 INFO [RS:1;jenkins-hbase9:33659] regionserver.HeapMemoryManager(220): Stopping 2023-09-27 14:03:37,070 INFO [RS:2;jenkins-hbase9:44379] regionserver.HeapMemoryManager(220): Stopping 2023-09-27 14:03:37,070 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-27 14:03:37,070 INFO [RS:2;jenkins-hbase9:44379] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-27 14:03:37,070 INFO [RS:1;jenkins-hbase9:33659] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-27 14:03:37,071 INFO [RS:2;jenkins-hbase9:44379] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-27 14:03:37,071 INFO [RS:0;jenkins-hbase9:43797] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:03:37,070 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-27 14:03:37,072 DEBUG [RS:0;jenkins-hbase9:43797] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x61c5abb0 to 127.0.0.1:60071 2023-09-27 14:03:37,072 INFO [RS:2;jenkins-hbase9:44379] regionserver.HRegionServer(3305): Received CLOSE for f648bd30610fcb063acfee82168ad9c8 2023-09-27 14:03:37,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 1f3d6c533eb0530f04a2c0dae249adc7, disabling compactions & flushes 2023-09-27 14:03:37,072 INFO [RS:2;jenkins-hbase9:44379] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:03:37,072 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695823274797.1f3d6c533eb0530f04a2c0dae249adc7. 2023-09-27 14:03:37,072 DEBUG [RS:2;jenkins-hbase9:44379] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6bd43af5 to 127.0.0.1:60071 2023-09-27 14:03:37,073 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing f648bd30610fcb063acfee82168ad9c8, disabling compactions & flushes 2023-09-27 14:03:37,073 DEBUG [RS:2;jenkins-hbase9:44379] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 14:03:37,071 INFO [RS:1;jenkins-hbase9:33659] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-27 14:03:37,073 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695823275561.f648bd30610fcb063acfee82168ad9c8. 2023-09-27 14:03:37,073 INFO [RS:1;jenkins-hbase9:33659] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:03:37,073 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695823275561.f648bd30610fcb063acfee82168ad9c8. 2023-09-27 14:03:37,073 DEBUG [RS:1;jenkins-hbase9:33659] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x01730409 to 127.0.0.1:60071 2023-09-27 14:03:37,072 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695823274797.1f3d6c533eb0530f04a2c0dae249adc7. 2023-09-27 14:03:37,072 DEBUG [RS:0;jenkins-hbase9:43797] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 14:03:37,073 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695823274797.1f3d6c533eb0530f04a2c0dae249adc7. after waiting 0 ms 2023-09-27 14:03:37,073 DEBUG [RS:1;jenkins-hbase9:33659] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 14:03:37,073 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695823275561.f648bd30610fcb063acfee82168ad9c8. after waiting 0 ms 2023-09-27 14:03:37,077 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695823275561.f648bd30610fcb063acfee82168ad9c8. 2023-09-27 14:03:37,077 INFO [RS:1;jenkins-hbase9:33659] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,33659,1695823272661; all regions closed. 2023-09-27 14:03:37,077 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing f648bd30610fcb063acfee82168ad9c8 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-09-27 14:03:37,073 INFO [RS:2;jenkins-hbase9:44379] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-27 14:03:37,076 INFO [RS:0;jenkins-hbase9:43797] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-27 14:03:37,076 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695823274797.1f3d6c533eb0530f04a2c0dae249adc7. 2023-09-27 14:03:37,077 INFO [RS:0;jenkins-hbase9:43797] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-27 14:03:37,077 DEBUG [RS:2;jenkins-hbase9:44379] regionserver.HRegionServer(1478): Online Regions={f648bd30610fcb063acfee82168ad9c8=hbase:acl,,1695823275561.f648bd30610fcb063acfee82168ad9c8.} 2023-09-27 14:03:37,077 INFO [RS:0;jenkins-hbase9:43797] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-27 14:03:37,077 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 1f3d6c533eb0530f04a2c0dae249adc7 1/1 column families, dataSize=78 B heapSize=488 B 2023-09-27 14:03:37,077 INFO [RS:0;jenkins-hbase9:43797] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-09-27 14:03:37,077 INFO [RS:0;jenkins-hbase9:43797] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-09-27 14:03:37,078 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-27 14:03:37,078 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-27 14:03:37,078 DEBUG [RS:0;jenkins-hbase9:43797] regionserver.HRegionServer(1478): Online Regions={1f3d6c533eb0530f04a2c0dae249adc7=hbase:namespace,,1695823274797.1f3d6c533eb0530f04a2c0dae249adc7., 1588230740=hbase:meta,,1.1588230740} 2023-09-27 14:03:37,078 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-27 14:03:37,078 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-27 14:03:37,078 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-27 14:03:37,078 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-09-27 14:03:37,079 DEBUG [RS:0;jenkins-hbase9:43797] regionserver.HRegionServer(1504): Waiting on 1588230740, 1f3d6c533eb0530f04a2c0dae249adc7 2023-09-27 14:03:37,079 DEBUG [RS:2;jenkins-hbase9:44379] regionserver.HRegionServer(1504): Waiting on f648bd30610fcb063acfee82168ad9c8 2023-09-27 14:03:37,096 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-27 14:03:37,096 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-27 14:03:37,096 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-27 14:03:37,100 DEBUG [RS:1;jenkins-hbase9:33659] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/oldWALs 2023-09-27 14:03:37,101 INFO [RS:1;jenkins-hbase9:33659] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C33659%2C1695823272661:(num 1695823274358) 2023-09-27 14:03:37,101 DEBUG [RS:1;jenkins-hbase9:33659] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 14:03:37,101 INFO [RS:1;jenkins-hbase9:33659] regionserver.LeaseManager(133): Closed leases 2023-09-27 14:03:37,106 INFO [RS:1;jenkins-hbase9:33659] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-27 14:03:37,112 INFO [RS:1;jenkins-hbase9:33659] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-27 14:03:37,112 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/hbase/acl/f648bd30610fcb063acfee82168ad9c8/.tmp/l/8c6336466a7043519f9ef90bd3d480b6 2023-09-27 14:03:37,112 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-27 14:03:37,112 INFO [RS:1;jenkins-hbase9:33659] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-27 14:03:37,113 INFO [RS:1;jenkins-hbase9:33659] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-27 14:03:37,115 INFO [RS:1;jenkins-hbase9:33659] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:33659 2023-09-27 14:03:37,118 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/hbase/meta/1588230740/.tmp/info/dcef527cac394bbbb29651fb3a90987e 2023-09-27 14:03:37,118 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/hbase/namespace/1f3d6c533eb0530f04a2c0dae249adc7/.tmp/info/d3cb816399404148ac34e3d11a9e2898 2023-09-27 14:03:37,122 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:03:37,122 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-27 14:03:37,122 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:03:37,122 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-27 14:03:37,122 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,33659,1695823272661 2023-09-27 14:03:37,122 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-27 14:03:37,122 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-27 14:03:37,123 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,33659,1695823272661] 2023-09-27 14:03:37,123 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,33659,1695823272661; numProcessing=1 2023-09-27 14:03:37,125 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dcef527cac394bbbb29651fb3a90987e 2023-09-27 14:03:37,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/hbase/namespace/1f3d6c533eb0530f04a2c0dae249adc7/.tmp/info/d3cb816399404148ac34e3d11a9e2898 as hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/hbase/namespace/1f3d6c533eb0530f04a2c0dae249adc7/info/d3cb816399404148ac34e3d11a9e2898 2023-09-27 14:03:37,126 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8c6336466a7043519f9ef90bd3d480b6 2023-09-27 14:03:37,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/hbase/acl/f648bd30610fcb063acfee82168ad9c8/.tmp/l/8c6336466a7043519f9ef90bd3d480b6 as hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/hbase/acl/f648bd30610fcb063acfee82168ad9c8/l/8c6336466a7043519f9ef90bd3d480b6 2023-09-27 14:03:37,128 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,33659,1695823272661 already deleted, retry=false 2023-09-27 14:03:37,128 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,33659,1695823272661 expired; onlineServers=2 2023-09-27 14:03:37,134 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8c6336466a7043519f9ef90bd3d480b6 2023-09-27 14:03:37,135 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/hbase/acl/f648bd30610fcb063acfee82168ad9c8/l/8c6336466a7043519f9ef90bd3d480b6, entries=7, sequenceid=18, filesize=5.2 K 2023-09-27 14:03:37,136 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for f648bd30610fcb063acfee82168ad9c8 in 59ms, sequenceid=18, compaction requested=false 2023-09-27 14:03:37,137 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/hbase/namespace/1f3d6c533eb0530f04a2c0dae249adc7/info/d3cb816399404148ac34e3d11a9e2898, entries=2, sequenceid=6, filesize=4.8 K 2023-09-27 14:03:37,138 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 1f3d6c533eb0530f04a2c0dae249adc7 in 61ms, sequenceid=6, compaction requested=false 2023-09-27 14:03:37,149 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/hbase/meta/1588230740/.tmp/rep_barrier/622f0f5c214249ad9ec3bdccd7ff3cb3 2023-09-27 14:03:37,157 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 622f0f5c214249ad9ec3bdccd7ff3cb3 2023-09-27 14:03:37,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/hbase/namespace/1f3d6c533eb0530f04a2c0dae249adc7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 14:03:37,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/hbase/acl/f648bd30610fcb063acfee82168ad9c8/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-09-27 14:03:37,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 14:03:37,168 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695823274797.1f3d6c533eb0530f04a2c0dae249adc7. 2023-09-27 14:03:37,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 1f3d6c533eb0530f04a2c0dae249adc7: 2023-09-27 14:03:37,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1695823274797.1f3d6c533eb0530f04a2c0dae249adc7. 2023-09-27 14:03:37,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 14:03:37,170 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1695823275561.f648bd30610fcb063acfee82168ad9c8. 2023-09-27 14:03:37,170 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for f648bd30610fcb063acfee82168ad9c8: 2023-09-27 14:03:37,170 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1695823275561.f648bd30610fcb063acfee82168ad9c8. 2023-09-27 14:03:37,178 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/hbase/meta/1588230740/.tmp/table/f37574c5a0c74e698c63df9f4e2474df 2023-09-27 14:03:37,182 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f37574c5a0c74e698c63df9f4e2474df 2023-09-27 14:03:37,183 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/hbase/meta/1588230740/.tmp/info/dcef527cac394bbbb29651fb3a90987e as hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/hbase/meta/1588230740/info/dcef527cac394bbbb29651fb3a90987e 2023-09-27 14:03:37,187 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dcef527cac394bbbb29651fb3a90987e 2023-09-27 14:03:37,187 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/hbase/meta/1588230740/info/dcef527cac394bbbb29651fb3a90987e, entries=48, sequenceid=131, filesize=10.3 K 2023-09-27 14:03:37,188 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/hbase/meta/1588230740/.tmp/rep_barrier/622f0f5c214249ad9ec3bdccd7ff3cb3 as hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/hbase/meta/1588230740/rep_barrier/622f0f5c214249ad9ec3bdccd7ff3cb3 2023-09-27 14:03:37,192 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 622f0f5c214249ad9ec3bdccd7ff3cb3 2023-09-27 14:03:37,192 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/hbase/meta/1588230740/rep_barrier/622f0f5c214249ad9ec3bdccd7ff3cb3, entries=13, sequenceid=131, filesize=6.4 K 2023-09-27 14:03:37,193 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/hbase/meta/1588230740/.tmp/table/f37574c5a0c74e698c63df9f4e2474df as hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/hbase/meta/1588230740/table/f37574c5a0c74e698c63df9f4e2474df 2023-09-27 14:03:37,193 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-09-27 14:03:37,193 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-09-27 14:03:37,196 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-09-27 14:03:37,196 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-09-27 14:03:37,197 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f37574c5a0c74e698c63df9f4e2474df 2023-09-27 14:03:37,197 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/hbase/meta/1588230740/table/f37574c5a0c74e698c63df9f4e2474df, entries=24, sequenceid=131, filesize=6.9 K 2023-09-27 14:03:37,198 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 120ms, sequenceid=131, compaction requested=false 2023-09-27 14:03:37,223 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-09-27 14:03:37,224 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-27 14:03:37,224 INFO [RS:1;jenkins-hbase9:33659] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,33659,1695823272661; zookeeper connection closed. 2023-09-27 14:03:37,224 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:33659-0x100eda3061c0002, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-27 14:03:37,224 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@760738c7] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@760738c7 2023-09-27 14:03:37,224 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 14:03:37,225 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-27 14:03:37,225 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-27 14:03:37,225 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-27 14:03:37,225 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-09-27 14:03:37,279 INFO [RS:0;jenkins-hbase9:43797] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,43797,1695823272608; all regions closed. 2023-09-27 14:03:37,279 INFO [RS:2;jenkins-hbase9:44379] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,44379,1695823272702; all regions closed. 2023-09-27 14:03:37,289 DEBUG [RS:0;jenkins-hbase9:43797] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/oldWALs 2023-09-27 14:03:37,289 DEBUG [RS:2;jenkins-hbase9:44379] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/oldWALs 2023-09-27 14:03:37,289 INFO [RS:0;jenkins-hbase9:43797] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C43797%2C1695823272608.meta:.meta(num 1695823274509) 2023-09-27 14:03:37,289 INFO [RS:2;jenkins-hbase9:44379] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C44379%2C1695823272702:(num 1695823274359) 2023-09-27 14:03:37,289 DEBUG [RS:2;jenkins-hbase9:44379] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 14:03:37,289 INFO [RS:2;jenkins-hbase9:44379] regionserver.LeaseManager(133): Closed leases 2023-09-27 14:03:37,290 INFO [RS:2;jenkins-hbase9:44379] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-27 14:03:37,290 INFO [RS:2;jenkins-hbase9:44379] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-27 14:03:37,290 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-27 14:03:37,290 INFO [RS:2;jenkins-hbase9:44379] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-27 14:03:37,290 INFO [RS:2;jenkins-hbase9:44379] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-27 14:03:37,291 INFO [RS:2;jenkins-hbase9:44379] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:44379 2023-09-27 14:03:37,295 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-27 14:03:37,295 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:03:37,296 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,44379,1695823272702 2023-09-27 14:03:37,296 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,44379,1695823272702] 2023-09-27 14:03:37,296 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,44379,1695823272702; numProcessing=2 2023-09-27 14:03:37,298 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,44379,1695823272702 already deleted, retry=false 2023-09-27 14:03:37,298 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,44379,1695823272702 expired; onlineServers=1 2023-09-27 14:03:37,298 DEBUG [RS:0;jenkins-hbase9:43797] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/oldWALs 2023-09-27 14:03:37,298 INFO [RS:0;jenkins-hbase9:43797] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C43797%2C1695823272608:(num 1695823274359) 2023-09-27 14:03:37,298 DEBUG [RS:0;jenkins-hbase9:43797] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 14:03:37,298 INFO [RS:0;jenkins-hbase9:43797] regionserver.LeaseManager(133): Closed leases 2023-09-27 14:03:37,298 INFO [RS:0;jenkins-hbase9:43797] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-27 14:03:37,299 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-27 14:03:37,299 INFO [RS:0;jenkins-hbase9:43797] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:43797 2023-09-27 14:03:37,302 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,43797,1695823272608 2023-09-27 14:03:37,302 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-27 14:03:37,303 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,43797,1695823272608] 2023-09-27 14:03:37,303 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,43797,1695823272608; numProcessing=3 2023-09-27 14:03:37,304 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,43797,1695823272608 already deleted, retry=false 2023-09-27 14:03:37,304 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,43797,1695823272608 expired; onlineServers=0 2023-09-27 14:03:37,304 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,32789,1695823271327' ***** 2023-09-27 14:03:37,304 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-09-27 14:03:37,304 DEBUG [M:0;jenkins-hbase9:32789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1807ca62, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-09-27 14:03:37,304 INFO [M:0;jenkins-hbase9:32789] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,32789,1695823271327 2023-09-27 14:03:37,304 INFO [M:0;jenkins-hbase9:32789] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,32789,1695823271327; all regions closed. 2023-09-27 14:03:37,304 DEBUG [M:0;jenkins-hbase9:32789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 14:03:37,304 DEBUG [M:0;jenkins-hbase9:32789] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-09-27 14:03:37,305 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-09-27 14:03:37,305 DEBUG [M:0;jenkins-hbase9:32789] cleaner.HFileCleaner(317): Stopping file delete threads 2023-09-27 14:03:37,305 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1695823273989] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1695823273989,5,FailOnTimeoutGroup] 2023-09-27 14:03:37,305 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1695823273990] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1695823273990,5,FailOnTimeoutGroup] 2023-09-27 14:03:37,305 INFO [M:0;jenkins-hbase9:32789] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-09-27 14:03:37,305 INFO [M:0;jenkins-hbase9:32789] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-09-27 14:03:37,305 INFO [M:0;jenkins-hbase9:32789] hbase.ChoreService(369): Chore service for: master/jenkins-hbase9:0 had [] on shutdown 2023-09-27 14:03:37,305 DEBUG [M:0;jenkins-hbase9:32789] master.HMaster(1512): Stopping service threads 2023-09-27 14:03:37,305 INFO [M:0;jenkins-hbase9:32789] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-09-27 14:03:37,305 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-09-27 14:03:37,305 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 14:03:37,306 ERROR [M:0;jenkins-hbase9:32789] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-14,5,PEWorkerGroup] Thread[HFileArchiver-16,5,PEWorkerGroup] 2023-09-27 14:03:37,306 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-27 14:03:37,306 INFO [M:0;jenkins-hbase9:32789] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-09-27 14:03:37,306 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-09-27 14:03:37,307 DEBUG [M:0;jenkins-hbase9:32789] zookeeper.ZKUtil(398): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-09-27 14:03:37,307 WARN [M:0;jenkins-hbase9:32789] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-09-27 14:03:37,307 INFO [M:0;jenkins-hbase9:32789] assignment.AssignmentManager(315): Stopping assignment manager 2023-09-27 14:03:37,307 INFO [M:0;jenkins-hbase9:32789] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-09-27 14:03:37,308 DEBUG [M:0;jenkins-hbase9:32789] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-27 14:03:37,308 INFO [M:0;jenkins-hbase9:32789] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-27 14:03:37,308 DEBUG [M:0;jenkins-hbase9:32789] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-27 14:03:37,308 DEBUG [M:0;jenkins-hbase9:32789] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-27 14:03:37,308 DEBUG [M:0;jenkins-hbase9:32789] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-27 14:03:37,308 INFO [M:0;jenkins-hbase9:32789] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.63 KB heapSize=451.89 KB 2023-09-27 14:03:37,326 INFO [M:0;jenkins-hbase9:32789] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.63 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/d0276af2d1fe444f930c194db5a3e764 2023-09-27 14:03:37,334 INFO [M:0;jenkins-hbase9:32789] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d0276af2d1fe444f930c194db5a3e764 2023-09-27 14:03:37,334 DEBUG [M:0;jenkins-hbase9:32789] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/d0276af2d1fe444f930c194db5a3e764 as hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/d0276af2d1fe444f930c194db5a3e764 2023-09-27 14:03:37,338 INFO [M:0;jenkins-hbase9:32789] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d0276af2d1fe444f930c194db5a3e764 2023-09-27 14:03:37,339 INFO [M:0;jenkins-hbase9:32789] regionserver.HStore(1080): Added hdfs://localhost:46363/user/jenkins/test-data/f59a3c0a-e40d-5f9a-c63c-cf9d7eb53c30/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/d0276af2d1fe444f930c194db5a3e764, entries=119, sequenceid=899, filesize=28.6 K 2023-09-27 14:03:37,340 INFO [M:0;jenkins-hbase9:32789] regionserver.HRegion(2948): Finished flush of dataSize ~375.63 KB/384649, heapSize ~451.88 KB/462720, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 31ms, sequenceid=899, compaction requested=false 2023-09-27 14:03:37,341 INFO [M:0;jenkins-hbase9:32789] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-27 14:03:37,341 DEBUG [M:0;jenkins-hbase9:32789] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-27 14:03:37,345 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-27 14:03:37,345 INFO [M:0;jenkins-hbase9:32789] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-09-27 14:03:37,346 INFO [M:0;jenkins-hbase9:32789] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:32789 2023-09-27 14:03:37,348 DEBUG [M:0;jenkins-hbase9:32789] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase9.apache.org,32789,1695823271327 already deleted, retry=false 2023-09-27 14:03:37,397 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-27 14:03:37,397 INFO [RS:2;jenkins-hbase9:44379] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,44379,1695823272702; zookeeper connection closed. 2023-09-27 14:03:37,397 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44379-0x100eda3061c0003, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-27 14:03:37,398 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@53b8e1fb] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@53b8e1fb 2023-09-27 14:03:37,498 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-27 14:03:37,498 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32789-0x100eda3061c0000, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-27 14:03:37,498 INFO [M:0;jenkins-hbase9:32789] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,32789,1695823271327; zookeeper connection closed. 2023-09-27 14:03:37,598 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-27 14:03:37,598 INFO [RS:0;jenkins-hbase9:43797] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,43797,1695823272608; zookeeper connection closed. 2023-09-27 14:03:37,598 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:43797-0x100eda3061c0001, quorum=127.0.0.1:60071, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-27 14:03:37,598 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6f75ded9] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6f75ded9 2023-09-27 14:03:37,599 INFO [Listener at jenkins-hbase9.apache.org/33737] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-09-27 14:03:37,599 WARN [Listener at jenkins-hbase9.apache.org/33737] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-27 14:03:37,603 INFO [Listener at jenkins-hbase9.apache.org/33737] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-27 14:03:37,707 WARN [BP-787274915-172.31.2.10-1695823267578 heartbeating to localhost/127.0.0.1:46363] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-27 14:03:37,708 WARN [BP-787274915-172.31.2.10-1695823267578 heartbeating to localhost/127.0.0.1:46363] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-787274915-172.31.2.10-1695823267578 (Datanode Uuid 4709409f-7736-47f6-af0b-bde70aa66439) service to localhost/127.0.0.1:46363 2023-09-27 14:03:37,709 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/cluster_b497cd91-1a8d-e480-fe2a-873529d0f364/dfs/data/data5/current/BP-787274915-172.31.2.10-1695823267578] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-27 14:03:37,710 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/cluster_b497cd91-1a8d-e480-fe2a-873529d0f364/dfs/data/data6/current/BP-787274915-172.31.2.10-1695823267578] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-27 14:03:37,711 WARN [Listener at jenkins-hbase9.apache.org/33737] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-27 14:03:37,713 INFO [Listener at jenkins-hbase9.apache.org/33737] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-27 14:03:37,816 WARN [BP-787274915-172.31.2.10-1695823267578 heartbeating to localhost/127.0.0.1:46363] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-27 14:03:37,816 WARN [BP-787274915-172.31.2.10-1695823267578 heartbeating to localhost/127.0.0.1:46363] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-787274915-172.31.2.10-1695823267578 (Datanode Uuid c1b54a2b-fdc3-40d0-aa11-413acb262056) service to localhost/127.0.0.1:46363 2023-09-27 14:03:37,817 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/cluster_b497cd91-1a8d-e480-fe2a-873529d0f364/dfs/data/data3/current/BP-787274915-172.31.2.10-1695823267578] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-27 14:03:37,817 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/cluster_b497cd91-1a8d-e480-fe2a-873529d0f364/dfs/data/data4/current/BP-787274915-172.31.2.10-1695823267578] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-27 14:03:37,818 WARN [Listener at jenkins-hbase9.apache.org/33737] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-27 14:03:37,823 INFO [Listener at jenkins-hbase9.apache.org/33737] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-27 14:03:37,926 WARN [BP-787274915-172.31.2.10-1695823267578 heartbeating to localhost/127.0.0.1:46363] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-27 14:03:37,926 WARN [BP-787274915-172.31.2.10-1695823267578 heartbeating to localhost/127.0.0.1:46363] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-787274915-172.31.2.10-1695823267578 (Datanode Uuid bffe9dd0-adc8-44ad-afc7-76b0bf5984f6) service to localhost/127.0.0.1:46363 2023-09-27 14:03:37,927 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/cluster_b497cd91-1a8d-e480-fe2a-873529d0f364/dfs/data/data1/current/BP-787274915-172.31.2.10-1695823267578] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-27 14:03:37,927 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8b593596-e684-8f1e-de3d-75a8f8b4d458/cluster_b497cd91-1a8d-e480-fe2a-873529d0f364/dfs/data/data2/current/BP-787274915-172.31.2.10-1695823267578] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-27 14:03:37,950 INFO [Listener at jenkins-hbase9.apache.org/33737] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-27 14:03:38,085 INFO [Listener at jenkins-hbase9.apache.org/33737] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-09-27 14:03:38,183 INFO [Listener at jenkins-hbase9.apache.org/33737] hbase.HBaseTestingUtility(1293): Minicluster is down