2023-07-17 12:10:52,570 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-17 12:10:52,834 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00 2023-07-17 12:10:52,834 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-17 12:10:52,881 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-17 12:10:53,135 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-17 12:10:53,136 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/cluster_9a1a9b04-7c81-e777-0050-74120a585f3f, deleteOnExit=true 2023-07-17 12:10:53,137 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-17 12:10:53,137 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/test.cache.data in system properties and HBase conf 2023-07-17 12:10:53,138 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/hadoop.tmp.dir in system properties and HBase conf 2023-07-17 12:10:53,138 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/hadoop.log.dir in system properties and HBase conf 2023-07-17 12:10:53,139 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-17 12:10:53,139 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-17 12:10:53,140 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-17 12:10:53,450 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-17 12:10:53,456 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-17 12:10:53,456 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-17 12:10:53,457 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-17 12:10:53,457 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-17 12:10:53,458 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-17 12:10:53,458 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-17 12:10:53,459 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-17 12:10:53,459 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-17 12:10:53,460 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-17 12:10:53,460 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/nfs.dump.dir in system properties and HBase conf 2023-07-17 12:10:53,461 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/java.io.tmpdir in system properties and HBase conf 2023-07-17 12:10:53,461 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-17 12:10:53,461 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-17 12:10:53,462 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-17 12:10:54,058 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-17 12:10:54,064 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-17 12:10:54,347 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-17 12:10:54,532 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-17 12:10:54,550 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 12:10:54,588 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 12:10:54,626 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/java.io.tmpdir/Jetty_localhost_37999_hdfs____.46bq5d/webapp 2023-07-17 12:10:54,787 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37999 2023-07-17 12:10:54,840 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-17 12:10:54,842 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-17 12:10:55,352 WARN [Listener at localhost/40781] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-17 12:10:55,445 WARN [Listener at localhost/40781] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-17 12:10:55,467 WARN [Listener at localhost/40781] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 12:10:55,474 INFO [Listener at localhost/40781] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 12:10:55,484 INFO [Listener at localhost/40781] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/java.io.tmpdir/Jetty_localhost_40221_datanode____.tlnd0k/webapp 2023-07-17 12:10:55,599 INFO [Listener at localhost/40781] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40221 2023-07-17 12:10:56,144 WARN [Listener at localhost/42911] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-17 12:10:56,185 WARN [Listener at localhost/42911] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-17 12:10:56,189 WARN [Listener at localhost/42911] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 12:10:56,192 INFO [Listener at localhost/42911] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 12:10:56,205 INFO [Listener at localhost/42911] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/java.io.tmpdir/Jetty_localhost_44409_datanode____zf9cf8/webapp 2023-07-17 12:10:56,347 INFO [Listener at localhost/42911] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44409 2023-07-17 12:10:56,374 WARN [Listener at localhost/43201] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-17 12:10:56,437 WARN [Listener at localhost/43201] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-17 12:10:56,447 WARN [Listener at localhost/43201] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 12:10:56,450 INFO [Listener at localhost/43201] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 12:10:56,458 INFO [Listener at localhost/43201] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/java.io.tmpdir/Jetty_localhost_42301_datanode____.4u0kwz/webapp 2023-07-17 12:10:56,607 INFO [Listener at localhost/43201] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42301 2023-07-17 12:10:56,646 WARN [Listener at localhost/40159] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-17 12:10:56,863 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe727e545b3b86429: Processing first storage report for DS-675a133a-dabe-46d7-b436-dab6d40745a7 from datanode 9c9fd580-9604-430b-a2e2-9accc2a082d3 2023-07-17 12:10:56,865 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe727e545b3b86429: from storage DS-675a133a-dabe-46d7-b436-dab6d40745a7 node DatanodeRegistration(127.0.0.1:33975, datanodeUuid=9c9fd580-9604-430b-a2e2-9accc2a082d3, infoPort=39563, infoSecurePort=0, ipcPort=43201, storageInfo=lv=-57;cid=testClusterID;nsid=1461880047;c=1689595854142), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-17 12:10:56,866 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xeb94b497805d8053: Processing first storage report for DS-23ddec88-0c8f-419a-aaa8-c58ea51cb0ad from datanode de150a68-7580-4b99-99f4-ba7d577ee59c 2023-07-17 12:10:56,866 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xeb94b497805d8053: from storage DS-23ddec88-0c8f-419a-aaa8-c58ea51cb0ad node DatanodeRegistration(127.0.0.1:37853, datanodeUuid=de150a68-7580-4b99-99f4-ba7d577ee59c, infoPort=45135, infoSecurePort=0, ipcPort=42911, storageInfo=lv=-57;cid=testClusterID;nsid=1461880047;c=1689595854142), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-17 12:10:56,866 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe727e545b3b86429: Processing first storage report for DS-429b8f52-12af-4eae-9a9f-e1d3bda09a87 from datanode 9c9fd580-9604-430b-a2e2-9accc2a082d3 2023-07-17 12:10:56,866 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe727e545b3b86429: from storage DS-429b8f52-12af-4eae-9a9f-e1d3bda09a87 node DatanodeRegistration(127.0.0.1:33975, datanodeUuid=9c9fd580-9604-430b-a2e2-9accc2a082d3, infoPort=39563, infoSecurePort=0, ipcPort=43201, storageInfo=lv=-57;cid=testClusterID;nsid=1461880047;c=1689595854142), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-17 12:10:56,866 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xeb94b497805d8053: Processing first storage report for DS-d0def116-d515-4822-84a9-d6c59e693c3c from datanode de150a68-7580-4b99-99f4-ba7d577ee59c 2023-07-17 12:10:56,866 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xeb94b497805d8053: from storage DS-d0def116-d515-4822-84a9-d6c59e693c3c node DatanodeRegistration(127.0.0.1:37853, datanodeUuid=de150a68-7580-4b99-99f4-ba7d577ee59c, infoPort=45135, infoSecurePort=0, ipcPort=42911, storageInfo=lv=-57;cid=testClusterID;nsid=1461880047;c=1689595854142), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-17 12:10:56,872 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x40ae2dbdc99a4be: Processing first storage report for DS-7e26a09b-f5a0-441a-ae20-3fc4e377a7ef from datanode 9b00fe6d-d317-45d5-b8dd-4edc0cc86bdc 2023-07-17 12:10:56,872 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x40ae2dbdc99a4be: from storage DS-7e26a09b-f5a0-441a-ae20-3fc4e377a7ef node DatanodeRegistration(127.0.0.1:42061, datanodeUuid=9b00fe6d-d317-45d5-b8dd-4edc0cc86bdc, infoPort=34491, infoSecurePort=0, ipcPort=40159, storageInfo=lv=-57;cid=testClusterID;nsid=1461880047;c=1689595854142), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-17 12:10:56,872 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x40ae2dbdc99a4be: Processing first storage report for DS-3ab0dffb-7eb2-4114-9cdc-61d67e414ac4 from datanode 9b00fe6d-d317-45d5-b8dd-4edc0cc86bdc 2023-07-17 12:10:56,872 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x40ae2dbdc99a4be: from storage DS-3ab0dffb-7eb2-4114-9cdc-61d67e414ac4 node DatanodeRegistration(127.0.0.1:42061, datanodeUuid=9b00fe6d-d317-45d5-b8dd-4edc0cc86bdc, infoPort=34491, infoSecurePort=0, ipcPort=40159, storageInfo=lv=-57;cid=testClusterID;nsid=1461880047;c=1689595854142), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-17 12:10:57,135 DEBUG [Listener at localhost/40159] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00 2023-07-17 12:10:57,219 INFO [Listener at localhost/40159] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/cluster_9a1a9b04-7c81-e777-0050-74120a585f3f/zookeeper_0, clientPort=60075, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/cluster_9a1a9b04-7c81-e777-0050-74120a585f3f/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/cluster_9a1a9b04-7c81-e777-0050-74120a585f3f/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-17 12:10:57,240 INFO [Listener at localhost/40159] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=60075 2023-07-17 12:10:57,251 INFO [Listener at localhost/40159] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 12:10:57,254 INFO [Listener at localhost/40159] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 12:10:58,002 INFO [Listener at localhost/40159] util.FSUtils(471): Created version file at hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c with version=8 2023-07-17 12:10:58,002 INFO [Listener at localhost/40159] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/hbase-staging 2023-07-17 12:10:58,384 INFO [Listener at localhost/40159] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-17 12:10:59,043 INFO [Listener at localhost/40159] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-17 12:10:59,083 INFO [Listener at localhost/40159] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 12:10:59,084 INFO [Listener at localhost/40159] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-17 12:10:59,085 INFO [Listener at localhost/40159] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-17 12:10:59,085 INFO [Listener at localhost/40159] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 12:10:59,085 INFO [Listener at localhost/40159] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-17 12:10:59,279 INFO [Listener at localhost/40159] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-17 12:10:59,367 DEBUG [Listener at localhost/40159] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-17 12:10:59,477 INFO [Listener at localhost/40159] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35573 2023-07-17 12:10:59,496 INFO [Listener at localhost/40159] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 12:10:59,499 INFO [Listener at localhost/40159] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 12:10:59,530 INFO [Listener at localhost/40159] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35573 connecting to ZooKeeper ensemble=127.0.0.1:60075 2023-07-17 12:10:59,594 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:355730x0, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-17 12:10:59,598 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:35573-0x10173314c320000 connected 2023-07-17 12:10:59,647 DEBUG [Listener at localhost/40159] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-17 12:10:59,648 DEBUG [Listener at localhost/40159] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 12:10:59,663 DEBUG [Listener at localhost/40159] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-17 12:10:59,677 DEBUG [Listener at localhost/40159] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35573 2023-07-17 12:10:59,678 DEBUG [Listener at localhost/40159] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35573 2023-07-17 12:10:59,679 DEBUG [Listener at localhost/40159] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35573 2023-07-17 12:10:59,683 DEBUG [Listener at localhost/40159] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35573 2023-07-17 12:10:59,683 DEBUG [Listener at localhost/40159] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35573 2023-07-17 12:10:59,690 INFO [Listener at localhost/40159] master.HMaster(444): hbase.rootdir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c, hbase.cluster.distributed=false 2023-07-17 12:10:59,758 INFO [Listener at localhost/40159] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-17 12:10:59,758 INFO [Listener at localhost/40159] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 12:10:59,758 INFO [Listener at localhost/40159] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-17 12:10:59,758 INFO [Listener at localhost/40159] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-17 12:10:59,758 INFO [Listener at localhost/40159] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 12:10:59,758 INFO [Listener at localhost/40159] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-17 12:10:59,763 INFO [Listener at localhost/40159] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-17 12:10:59,771 INFO [Listener at localhost/40159] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34107 2023-07-17 12:10:59,774 INFO [Listener at localhost/40159] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-17 12:10:59,783 DEBUG [Listener at localhost/40159] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-17 12:10:59,784 INFO [Listener at localhost/40159] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 12:10:59,786 INFO [Listener at localhost/40159] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 12:10:59,788 INFO [Listener at localhost/40159] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34107 connecting to ZooKeeper ensemble=127.0.0.1:60075 2023-07-17 12:10:59,794 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:341070x0, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-17 12:10:59,796 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34107-0x10173314c320001 connected 2023-07-17 12:10:59,796 DEBUG [Listener at localhost/40159] zookeeper.ZKUtil(164): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-17 12:10:59,799 DEBUG [Listener at localhost/40159] zookeeper.ZKUtil(164): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 12:10:59,800 DEBUG [Listener at localhost/40159] zookeeper.ZKUtil(164): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-17 12:10:59,802 DEBUG [Listener at localhost/40159] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34107 2023-07-17 12:10:59,806 DEBUG [Listener at localhost/40159] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34107 2023-07-17 12:10:59,809 DEBUG [Listener at localhost/40159] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34107 2023-07-17 12:10:59,811 DEBUG [Listener at localhost/40159] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34107 2023-07-17 12:10:59,811 DEBUG [Listener at localhost/40159] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34107 2023-07-17 12:10:59,827 INFO [Listener at localhost/40159] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-17 12:10:59,827 INFO [Listener at localhost/40159] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 12:10:59,827 INFO [Listener at localhost/40159] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-17 12:10:59,828 INFO [Listener at localhost/40159] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-17 12:10:59,828 INFO [Listener at localhost/40159] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 12:10:59,828 INFO [Listener at localhost/40159] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-17 12:10:59,828 INFO [Listener at localhost/40159] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-17 12:10:59,830 INFO [Listener at localhost/40159] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37767 2023-07-17 12:10:59,831 INFO [Listener at localhost/40159] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-17 12:10:59,834 DEBUG [Listener at localhost/40159] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-17 12:10:59,835 INFO [Listener at localhost/40159] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 12:10:59,838 INFO [Listener at localhost/40159] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 12:10:59,841 INFO [Listener at localhost/40159] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37767 connecting to ZooKeeper ensemble=127.0.0.1:60075 2023-07-17 12:10:59,846 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:377670x0, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-17 12:10:59,847 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:37767-0x10173314c320002 connected 2023-07-17 12:10:59,848 DEBUG [Listener at localhost/40159] zookeeper.ZKUtil(164): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-17 12:10:59,849 DEBUG [Listener at localhost/40159] zookeeper.ZKUtil(164): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 12:10:59,850 DEBUG [Listener at localhost/40159] zookeeper.ZKUtil(164): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-17 12:10:59,854 DEBUG [Listener at localhost/40159] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37767 2023-07-17 12:10:59,856 DEBUG [Listener at localhost/40159] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37767 2023-07-17 12:10:59,856 DEBUG [Listener at localhost/40159] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37767 2023-07-17 12:10:59,862 DEBUG [Listener at localhost/40159] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37767 2023-07-17 12:10:59,862 DEBUG [Listener at localhost/40159] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37767 2023-07-17 12:10:59,881 INFO [Listener at localhost/40159] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-17 12:10:59,881 INFO [Listener at localhost/40159] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 12:10:59,881 INFO [Listener at localhost/40159] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-17 12:10:59,882 INFO [Listener at localhost/40159] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-17 12:10:59,882 INFO [Listener at localhost/40159] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 12:10:59,882 INFO [Listener at localhost/40159] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-17 12:10:59,882 INFO [Listener at localhost/40159] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-17 12:10:59,884 INFO [Listener at localhost/40159] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44163 2023-07-17 12:10:59,884 INFO [Listener at localhost/40159] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-17 12:10:59,890 DEBUG [Listener at localhost/40159] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-17 12:10:59,891 INFO [Listener at localhost/40159] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 12:10:59,893 INFO [Listener at localhost/40159] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 12:10:59,894 INFO [Listener at localhost/40159] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44163 connecting to ZooKeeper ensemble=127.0.0.1:60075 2023-07-17 12:10:59,900 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:441630x0, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-17 12:10:59,901 DEBUG [Listener at localhost/40159] zookeeper.ZKUtil(164): regionserver:441630x0, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-17 12:10:59,902 DEBUG [Listener at localhost/40159] zookeeper.ZKUtil(164): regionserver:441630x0, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 12:10:59,903 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44163-0x10173314c320003 connected 2023-07-17 12:10:59,903 DEBUG [Listener at localhost/40159] zookeeper.ZKUtil(164): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-17 12:10:59,906 DEBUG [Listener at localhost/40159] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44163 2023-07-17 12:10:59,907 DEBUG [Listener at localhost/40159] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44163 2023-07-17 12:10:59,910 DEBUG [Listener at localhost/40159] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44163 2023-07-17 12:10:59,914 DEBUG [Listener at localhost/40159] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44163 2023-07-17 12:10:59,915 DEBUG [Listener at localhost/40159] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44163 2023-07-17 12:10:59,919 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,35573,1689595858202 2023-07-17 12:10:59,931 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-17 12:10:59,933 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,35573,1689595858202 2023-07-17 12:10:59,960 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-17 12:10:59,960 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-17 12:10:59,960 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-17 12:10:59,962 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-17 12:10:59,963 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 12:10:59,965 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-17 12:10:59,967 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,35573,1689595858202 from backup master directory 2023-07-17 12:10:59,970 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-17 12:10:59,974 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,35573,1689595858202 2023-07-17 12:10:59,974 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-17 12:10:59,975 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-17 12:10:59,975 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,35573,1689595858202 2023-07-17 12:10:59,979 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-17 12:10:59,984 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-17 12:11:00,104 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/hbase.id with ID: 7c9cad10-e686-48b0-86ff-2df0341c0b19 2023-07-17 12:11:00,151 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 12:11:00,169 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 12:11:00,260 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x3489156c to 127.0.0.1:60075 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:11:00,315 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a4de41f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:11:00,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-17 12:11:00,351 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-17 12:11:00,371 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-17 12:11:00,371 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-17 12:11:00,373 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-17 12:11:00,379 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-17 12:11:00,380 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-17 12:11:00,424 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/MasterData/data/master/store-tmp 2023-07-17 12:11:00,462 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:11:00,462 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-17 12:11:00,462 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 12:11:00,462 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 12:11:00,462 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-17 12:11:00,462 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 12:11:00,462 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 12:11:00,463 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-17 12:11:00,470 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/MasterData/WALs/jenkins-hbase4.apache.org,35573,1689595858202 2023-07-17 12:11:00,510 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35573%2C1689595858202, suffix=, logDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/MasterData/WALs/jenkins-hbase4.apache.org,35573,1689595858202, archiveDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/MasterData/oldWALs, maxLogs=10 2023-07-17 12:11:00,585 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42061,DS-7e26a09b-f5a0-441a-ae20-3fc4e377a7ef,DISK] 2023-07-17 12:11:00,585 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37853,DS-23ddec88-0c8f-419a-aaa8-c58ea51cb0ad,DISK] 2023-07-17 12:11:00,588 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33975,DS-675a133a-dabe-46d7-b436-dab6d40745a7,DISK] 2023-07-17 12:11:00,596 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-17 12:11:00,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/MasterData/WALs/jenkins-hbase4.apache.org,35573,1689595858202/jenkins-hbase4.apache.org%2C35573%2C1689595858202.1689595860523 2023-07-17 12:11:00,699 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37853,DS-23ddec88-0c8f-419a-aaa8-c58ea51cb0ad,DISK], DatanodeInfoWithStorage[127.0.0.1:33975,DS-675a133a-dabe-46d7-b436-dab6d40745a7,DISK], DatanodeInfoWithStorage[127.0.0.1:42061,DS-7e26a09b-f5a0-441a-ae20-3fc4e377a7ef,DISK]] 2023-07-17 12:11:00,700 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-17 12:11:00,700 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:11:00,705 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-17 12:11:00,706 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-17 12:11:00,796 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-17 12:11:00,804 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-17 12:11:00,849 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-17 12:11:00,865 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 12:11:00,874 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-17 12:11:00,876 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-17 12:11:00,898 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-17 12:11:00,906 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 12:11:00,907 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70982348, jitterRate=0.057719409465789795}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 12:11:00,907 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-17 12:11:00,909 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-17 12:11:00,933 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-17 12:11:00,933 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-17 12:11:00,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-17 12:11:00,937 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-17 12:11:00,977 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 39 msec 2023-07-17 12:11:00,977 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-17 12:11:01,017 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-17 12:11:01,023 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-17 12:11:01,052 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-17 12:11:01,057 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-17 12:11:01,058 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-17 12:11:01,064 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-17 12:11:01,069 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-17 12:11:01,072 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 12:11:01,074 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-17 12:11:01,075 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-17 12:11:01,093 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-17 12:11:01,098 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-17 12:11:01,098 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-17 12:11:01,098 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-17 12:11:01,099 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-17 12:11:01,099 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 12:11:01,099 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,35573,1689595858202, sessionid=0x10173314c320000, setting cluster-up flag (Was=false) 2023-07-17 12:11:01,121 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 12:11:01,129 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-17 12:11:01,143 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35573,1689595858202 2023-07-17 12:11:01,153 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 12:11:01,161 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-17 12:11:01,165 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35573,1689595858202 2023-07-17 12:11:01,168 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp 2023-07-17 12:11:01,221 INFO [RS:1;jenkins-hbase4:37767] regionserver.HRegionServer(951): ClusterId : 7c9cad10-e686-48b0-86ff-2df0341c0b19 2023-07-17 12:11:01,221 INFO [RS:0;jenkins-hbase4:34107] regionserver.HRegionServer(951): ClusterId : 7c9cad10-e686-48b0-86ff-2df0341c0b19 2023-07-17 12:11:01,231 INFO [RS:2;jenkins-hbase4:44163] regionserver.HRegionServer(951): ClusterId : 7c9cad10-e686-48b0-86ff-2df0341c0b19 2023-07-17 12:11:01,231 DEBUG [RS:0;jenkins-hbase4:34107] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-17 12:11:01,231 DEBUG [RS:1;jenkins-hbase4:37767] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-17 12:11:01,232 DEBUG [RS:2;jenkins-hbase4:44163] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-17 12:11:01,240 DEBUG [RS:0;jenkins-hbase4:34107] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-17 12:11:01,240 DEBUG [RS:1;jenkins-hbase4:37767] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-17 12:11:01,240 DEBUG [RS:1;jenkins-hbase4:37767] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-17 12:11:01,240 DEBUG [RS:0;jenkins-hbase4:34107] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-17 12:11:01,240 DEBUG [RS:2;jenkins-hbase4:44163] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-17 12:11:01,241 DEBUG [RS:2;jenkins-hbase4:44163] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-17 12:11:01,246 DEBUG [RS:1;jenkins-hbase4:37767] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-17 12:11:01,256 DEBUG [RS:2;jenkins-hbase4:44163] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-17 12:11:01,258 DEBUG [RS:0;jenkins-hbase4:34107] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-17 12:11:01,258 DEBUG [RS:2;jenkins-hbase4:44163] zookeeper.ReadOnlyZKClient(139): Connect 0x17a516e2 to 127.0.0.1:60075 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:11:01,257 DEBUG [RS:1;jenkins-hbase4:37767] zookeeper.ReadOnlyZKClient(139): Connect 0x536d3d9a to 127.0.0.1:60075 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:11:01,269 DEBUG [RS:0;jenkins-hbase4:34107] zookeeper.ReadOnlyZKClient(139): Connect 0x3c72b8e9 to 127.0.0.1:60075 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:11:01,307 DEBUG [RS:0;jenkins-hbase4:34107] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8c9e925, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:11:01,308 DEBUG [RS:0;jenkins-hbase4:34107] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3802843, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-17 12:11:01,321 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-17 12:11:01,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 12:11:01,327 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-17 12:11:01,343 DEBUG [RS:2;jenkins-hbase4:44163] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1962ea66, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:11:01,343 DEBUG [RS:2;jenkins-hbase4:44163] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d5d7d92, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-17 12:11:01,358 DEBUG [RS:1;jenkins-hbase4:37767] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@127eaa22, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:11:01,358 DEBUG [RS:1;jenkins-hbase4:37767] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@32ef9d69, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-17 12:11:01,363 DEBUG [RS:0;jenkins-hbase4:34107] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:34107 2023-07-17 12:11:01,368 DEBUG [RS:2;jenkins-hbase4:44163] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:44163 2023-07-17 12:11:01,372 INFO [RS:0;jenkins-hbase4:34107] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-17 12:11:01,372 INFO [RS:0;jenkins-hbase4:34107] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-17 12:11:01,372 DEBUG [RS:0;jenkins-hbase4:34107] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-17 12:11:01,373 INFO [RS:0;jenkins-hbase4:34107] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 12:11:01,375 INFO [RS:2;jenkins-hbase4:44163] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-17 12:11:01,383 INFO [RS:2;jenkins-hbase4:44163] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-17 12:11:01,383 DEBUG [RS:2;jenkins-hbase4:44163] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-17 12:11:01,383 INFO [RS:2;jenkins-hbase4:44163] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 12:11:01,383 DEBUG [RS:2;jenkins-hbase4:44163] regionserver.HRegionServer(1022): About to register with Master. 2023-07-17 12:11:01,384 DEBUG [RS:1;jenkins-hbase4:37767] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:37767 2023-07-17 12:11:01,384 INFO [RS:1;jenkins-hbase4:37767] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-17 12:11:01,384 INFO [RS:1;jenkins-hbase4:37767] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-17 12:11:01,383 DEBUG [RS:0;jenkins-hbase4:34107] regionserver.HRegionServer(1022): About to register with Master. 2023-07-17 12:11:01,385 DEBUG [RS:1;jenkins-hbase4:37767] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-17 12:11:01,385 INFO [RS:1;jenkins-hbase4:37767] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 12:11:01,385 DEBUG [RS:1;jenkins-hbase4:37767] regionserver.HRegionServer(1022): About to register with Master. 2023-07-17 12:11:01,387 INFO [RS:0;jenkins-hbase4:34107] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,35573,1689595858202 with isa=jenkins-hbase4.apache.org/172.31.14.131:34107, startcode=1689595859757 2023-07-17 12:11:01,387 INFO [RS:2;jenkins-hbase4:44163] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,35573,1689595858202 with isa=jenkins-hbase4.apache.org/172.31.14.131:44163, startcode=1689595859880 2023-07-17 12:11:01,399 INFO [RS:1;jenkins-hbase4:37767] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,35573,1689595858202 with isa=jenkins-hbase4.apache.org/172.31.14.131:37767, startcode=1689595859826 2023-07-17 12:11:01,420 DEBUG [RS:1;jenkins-hbase4:37767] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-17 12:11:01,420 DEBUG [RS:2;jenkins-hbase4:44163] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-17 12:11:01,423 DEBUG [RS:0;jenkins-hbase4:34107] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-17 12:11:01,504 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-17 12:11:01,513 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40579, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-17 12:11:01,513 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55609, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-17 12:11:01,513 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45231, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-17 12:11:01,516 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-17 12:11:01,517 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-17 12:11:01,517 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-17 12:11:01,517 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-17 12:11:01,517 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-17 12:11:01,517 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,517 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-17 12:11:01,517 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,535 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35573] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-17 12:11:01,535 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689595891535 2023-07-17 12:11:01,539 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-17 12:11:01,545 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-17 12:11:01,546 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-17 12:11:01,558 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35573] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-17 12:11:01,559 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35573] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-17 12:11:01,564 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-17 12:11:01,566 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-17 12:11:01,574 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-17 12:11:01,574 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-17 12:11:01,575 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-17 12:11:01,575 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-17 12:11:01,578 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:01,580 DEBUG [RS:2;jenkins-hbase4:44163] regionserver.HRegionServer(2830): Master is not running yet 2023-07-17 12:11:01,580 DEBUG [RS:0;jenkins-hbase4:34107] regionserver.HRegionServer(2830): Master is not running yet 2023-07-17 12:11:01,581 WARN [RS:0;jenkins-hbase4:34107] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-17 12:11:01,580 DEBUG [RS:1;jenkins-hbase4:37767] regionserver.HRegionServer(2830): Master is not running yet 2023-07-17 12:11:01,581 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-17 12:11:01,581 WARN [RS:2;jenkins-hbase4:44163] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-17 12:11:01,581 WARN [RS:1;jenkins-hbase4:37767] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-17 12:11:01,583 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-17 12:11:01,584 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-17 12:11:01,588 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-17 12:11:01,589 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-17 12:11:01,591 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689595861590,5,FailOnTimeoutGroup] 2023-07-17 12:11:01,591 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689595861591,5,FailOnTimeoutGroup] 2023-07-17 12:11:01,591 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:01,591 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-17 12:11:01,593 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:01,593 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:01,632 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-17 12:11:01,633 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-17 12:11:01,633 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c 2023-07-17 12:11:01,669 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:11:01,672 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-17 12:11:01,676 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/hbase/meta/1588230740/info 2023-07-17 12:11:01,677 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-17 12:11:01,679 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 12:11:01,679 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-17 12:11:01,682 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/hbase/meta/1588230740/rep_barrier 2023-07-17 12:11:01,683 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-17 12:11:01,683 INFO [RS:0;jenkins-hbase4:34107] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,35573,1689595858202 with isa=jenkins-hbase4.apache.org/172.31.14.131:34107, startcode=1689595859757 2023-07-17 12:11:01,684 INFO [RS:2;jenkins-hbase4:44163] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,35573,1689595858202 with isa=jenkins-hbase4.apache.org/172.31.14.131:44163, startcode=1689595859880 2023-07-17 12:11:01,685 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 12:11:01,685 INFO [RS:1;jenkins-hbase4:37767] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,35573,1689595858202 with isa=jenkins-hbase4.apache.org/172.31.14.131:37767, startcode=1689595859826 2023-07-17 12:11:01,686 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-17 12:11:01,689 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/hbase/meta/1588230740/table 2023-07-17 12:11:01,689 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-17 12:11:01,690 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35573] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:01,693 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 12:11:01,695 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/hbase/meta/1588230740 2023-07-17 12:11:01,696 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/hbase/meta/1588230740 2023-07-17 12:11:01,697 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35573] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:01,697 DEBUG [RS:0;jenkins-hbase4:34107] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c 2023-07-17 12:11:01,698 DEBUG [RS:0;jenkins-hbase4:34107] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:40781 2023-07-17 12:11:01,698 DEBUG [RS:0;jenkins-hbase4:34107] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-17 12:11:01,702 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35573] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:01,703 DEBUG [RS:2;jenkins-hbase4:44163] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c 2023-07-17 12:11:01,703 DEBUG [RS:2;jenkins-hbase4:44163] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:40781 2023-07-17 12:11:01,703 DEBUG [RS:2;jenkins-hbase4:44163] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-17 12:11:01,703 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-17 12:11:01,705 DEBUG [RS:0;jenkins-hbase4:34107] zookeeper.ZKUtil(162): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:01,705 DEBUG [RS:1;jenkins-hbase4:37767] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c 2023-07-17 12:11:01,706 WARN [RS:0;jenkins-hbase4:34107] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-17 12:11:01,706 DEBUG [RS:1;jenkins-hbase4:37767] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:40781 2023-07-17 12:11:01,706 INFO [RS:0;jenkins-hbase4:34107] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-17 12:11:01,706 DEBUG [RS:1;jenkins-hbase4:37767] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-17 12:11:01,706 DEBUG [RS:0;jenkins-hbase4:34107] regionserver.HRegionServer(1948): logDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/WALs/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:01,710 DEBUG [RS:2;jenkins-hbase4:44163] zookeeper.ZKUtil(162): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:01,711 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-17 12:11:01,713 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-17 12:11:01,710 WARN [RS:2;jenkins-hbase4:44163] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-17 12:11:01,719 INFO [RS:2;jenkins-hbase4:44163] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-17 12:11:01,720 DEBUG [RS:2;jenkins-hbase4:44163] regionserver.HRegionServer(1948): logDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/WALs/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:01,720 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-17 12:11:01,720 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34107,1689595859757] 2023-07-17 12:11:01,720 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44163,1689595859880] 2023-07-17 12:11:01,725 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 12:11:01,727 DEBUG [RS:1;jenkins-hbase4:37767] zookeeper.ZKUtil(162): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:01,728 WARN [RS:1;jenkins-hbase4:37767] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-17 12:11:01,728 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37767,1689595859826] 2023-07-17 12:11:01,728 INFO [RS:1;jenkins-hbase4:37767] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-17 12:11:01,728 DEBUG [RS:1;jenkins-hbase4:37767] regionserver.HRegionServer(1948): logDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/WALs/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:01,728 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72294109, jitterRate=0.07726617157459259}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-17 12:11:01,728 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-17 12:11:01,728 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-17 12:11:01,728 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-17 12:11:01,728 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-17 12:11:01,729 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-17 12:11:01,729 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-17 12:11:01,730 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-17 12:11:01,731 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-17 12:11:01,734 DEBUG [RS:0;jenkins-hbase4:34107] zookeeper.ZKUtil(162): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:01,735 DEBUG [RS:2;jenkins-hbase4:44163] zookeeper.ZKUtil(162): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:01,735 DEBUG [RS:2;jenkins-hbase4:44163] zookeeper.ZKUtil(162): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:01,735 DEBUG [RS:0;jenkins-hbase4:34107] zookeeper.ZKUtil(162): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:01,736 DEBUG [RS:2;jenkins-hbase4:44163] zookeeper.ZKUtil(162): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:01,737 DEBUG [RS:0;jenkins-hbase4:34107] zookeeper.ZKUtil(162): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:01,738 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-17 12:11:01,738 DEBUG [RS:1;jenkins-hbase4:37767] zookeeper.ZKUtil(162): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:01,738 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-17 12:11:01,739 DEBUG [RS:1;jenkins-hbase4:37767] zookeeper.ZKUtil(162): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:01,739 DEBUG [RS:1;jenkins-hbase4:37767] zookeeper.ZKUtil(162): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:01,751 DEBUG [RS:0;jenkins-hbase4:34107] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-17 12:11:01,751 DEBUG [RS:1;jenkins-hbase4:37767] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-17 12:11:01,752 DEBUG [RS:2;jenkins-hbase4:44163] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-17 12:11:01,753 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-17 12:11:01,765 INFO [RS:0;jenkins-hbase4:34107] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-17 12:11:01,766 INFO [RS:2;jenkins-hbase4:44163] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-17 12:11:01,765 INFO [RS:1;jenkins-hbase4:37767] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-17 12:11:01,772 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-17 12:11:01,776 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-17 12:11:01,801 INFO [RS:2;jenkins-hbase4:44163] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-17 12:11:01,804 INFO [RS:0;jenkins-hbase4:34107] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-17 12:11:01,801 INFO [RS:1;jenkins-hbase4:37767] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-17 12:11:01,814 INFO [RS:1;jenkins-hbase4:37767] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-17 12:11:01,814 INFO [RS:1;jenkins-hbase4:37767] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:01,824 INFO [RS:0;jenkins-hbase4:34107] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-17 12:11:01,840 INFO [RS:2;jenkins-hbase4:44163] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-17 12:11:01,840 INFO [RS:1;jenkins-hbase4:37767] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-17 12:11:01,839 INFO [RS:0;jenkins-hbase4:34107] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:01,840 INFO [RS:2;jenkins-hbase4:44163] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:01,848 INFO [RS:0;jenkins-hbase4:34107] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-17 12:11:01,858 INFO [RS:2;jenkins-hbase4:44163] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-17 12:11:01,875 INFO [RS:2;jenkins-hbase4:44163] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:01,876 DEBUG [RS:2;jenkins-hbase4:44163] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,876 DEBUG [RS:2;jenkins-hbase4:44163] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,876 DEBUG [RS:2;jenkins-hbase4:44163] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,876 DEBUG [RS:2;jenkins-hbase4:44163] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,876 DEBUG [RS:2;jenkins-hbase4:44163] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,876 DEBUG [RS:2;jenkins-hbase4:44163] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-17 12:11:01,877 DEBUG [RS:2;jenkins-hbase4:44163] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,877 DEBUG [RS:2;jenkins-hbase4:44163] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,877 DEBUG [RS:2;jenkins-hbase4:44163] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,877 DEBUG [RS:2;jenkins-hbase4:44163] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,883 INFO [RS:0;jenkins-hbase4:34107] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:01,883 INFO [RS:1;jenkins-hbase4:37767] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:01,890 INFO [RS:2;jenkins-hbase4:44163] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:01,891 INFO [RS:2;jenkins-hbase4:44163] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:01,891 INFO [RS:2;jenkins-hbase4:44163] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:01,883 DEBUG [RS:0;jenkins-hbase4:34107] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,893 DEBUG [RS:1;jenkins-hbase4:37767] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,893 DEBUG [RS:0;jenkins-hbase4:34107] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,893 DEBUG [RS:1;jenkins-hbase4:37767] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,893 DEBUG [RS:0;jenkins-hbase4:34107] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,893 DEBUG [RS:1;jenkins-hbase4:37767] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,893 DEBUG [RS:0;jenkins-hbase4:34107] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,893 DEBUG [RS:1;jenkins-hbase4:37767] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,894 DEBUG [RS:0;jenkins-hbase4:34107] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,894 DEBUG [RS:1;jenkins-hbase4:37767] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,894 DEBUG [RS:0;jenkins-hbase4:34107] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-17 12:11:01,894 DEBUG [RS:1;jenkins-hbase4:37767] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-17 12:11:01,894 DEBUG [RS:0;jenkins-hbase4:34107] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,894 DEBUG [RS:1;jenkins-hbase4:37767] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,894 DEBUG [RS:0;jenkins-hbase4:34107] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,894 DEBUG [RS:1;jenkins-hbase4:37767] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,894 DEBUG [RS:0;jenkins-hbase4:34107] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,894 DEBUG [RS:1;jenkins-hbase4:37767] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,894 DEBUG [RS:0;jenkins-hbase4:34107] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,894 DEBUG [RS:1;jenkins-hbase4:37767] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 12:11:01,911 INFO [RS:0;jenkins-hbase4:34107] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:01,911 INFO [RS:0;jenkins-hbase4:34107] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:01,911 INFO [RS:0;jenkins-hbase4:34107] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:01,918 INFO [RS:1;jenkins-hbase4:37767] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:01,918 INFO [RS:1;jenkins-hbase4:37767] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:01,918 INFO [RS:1;jenkins-hbase4:37767] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:01,928 DEBUG [jenkins-hbase4:35573] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-17 12:11:01,929 INFO [RS:2;jenkins-hbase4:44163] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-17 12:11:01,933 INFO [RS:2;jenkins-hbase4:44163] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44163,1689595859880-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:01,938 DEBUG [jenkins-hbase4:35573] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 12:11:01,946 INFO [RS:0;jenkins-hbase4:34107] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-17 12:11:01,953 INFO [RS:0;jenkins-hbase4:34107] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34107,1689595859757-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:01,947 INFO [RS:1;jenkins-hbase4:37767] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-17 12:11:01,953 INFO [RS:1;jenkins-hbase4:37767] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37767,1689595859826-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:01,962 DEBUG [jenkins-hbase4:35573] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 12:11:01,962 DEBUG [jenkins-hbase4:35573] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 12:11:01,962 DEBUG [jenkins-hbase4:35573] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 12:11:01,962 DEBUG [jenkins-hbase4:35573] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 12:11:01,973 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34107,1689595859757, state=OPENING 2023-07-17 12:11:01,984 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-17 12:11:01,986 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 12:11:01,989 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-17 12:11:01,995 INFO [RS:0;jenkins-hbase4:34107] regionserver.Replication(203): jenkins-hbase4.apache.org,34107,1689595859757 started 2023-07-17 12:11:01,995 INFO [RS:0;jenkins-hbase4:34107] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,34107,1689595859757, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34107, sessionid=0x10173314c320001 2023-07-17 12:11:01,995 DEBUG [RS:0;jenkins-hbase4:34107] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-17 12:11:01,995 DEBUG [RS:0;jenkins-hbase4:34107] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:01,995 DEBUG [RS:0;jenkins-hbase4:34107] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34107,1689595859757' 2023-07-17 12:11:01,996 DEBUG [RS:0;jenkins-hbase4:34107] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-17 12:11:01,998 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34107,1689595859757}] 2023-07-17 12:11:02,002 DEBUG [RS:0;jenkins-hbase4:34107] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-17 12:11:02,003 DEBUG [RS:0;jenkins-hbase4:34107] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-17 12:11:02,003 DEBUG [RS:0;jenkins-hbase4:34107] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-17 12:11:02,003 DEBUG [RS:0;jenkins-hbase4:34107] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:02,004 DEBUG [RS:0;jenkins-hbase4:34107] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34107,1689595859757' 2023-07-17 12:11:02,004 DEBUG [RS:0;jenkins-hbase4:34107] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:02,005 DEBUG [RS:0;jenkins-hbase4:34107] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:02,007 DEBUG [RS:0;jenkins-hbase4:34107] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-17 12:11:02,007 INFO [RS:0;jenkins-hbase4:34107] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-17 12:11:02,007 INFO [RS:0;jenkins-hbase4:34107] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-17 12:11:02,011 INFO [RS:1;jenkins-hbase4:37767] regionserver.Replication(203): jenkins-hbase4.apache.org,37767,1689595859826 started 2023-07-17 12:11:02,011 INFO [RS:1;jenkins-hbase4:37767] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,37767,1689595859826, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37767, sessionid=0x10173314c320002 2023-07-17 12:11:02,011 INFO [RS:2;jenkins-hbase4:44163] regionserver.Replication(203): jenkins-hbase4.apache.org,44163,1689595859880 started 2023-07-17 12:11:02,011 DEBUG [RS:1;jenkins-hbase4:37767] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-17 12:11:02,011 INFO [RS:2;jenkins-hbase4:44163] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,44163,1689595859880, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44163, sessionid=0x10173314c320003 2023-07-17 12:11:02,012 DEBUG [RS:2;jenkins-hbase4:44163] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-17 12:11:02,012 DEBUG [RS:1;jenkins-hbase4:37767] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:02,012 DEBUG [RS:2;jenkins-hbase4:44163] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:02,013 DEBUG [RS:1;jenkins-hbase4:37767] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37767,1689595859826' 2023-07-17 12:11:02,015 DEBUG [RS:1;jenkins-hbase4:37767] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-17 12:11:02,014 DEBUG [RS:2;jenkins-hbase4:44163] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44163,1689595859880' 2023-07-17 12:11:02,015 DEBUG [RS:2;jenkins-hbase4:44163] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-17 12:11:02,015 DEBUG [RS:1;jenkins-hbase4:37767] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-17 12:11:02,015 DEBUG [RS:2;jenkins-hbase4:44163] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-17 12:11:02,018 DEBUG [RS:1;jenkins-hbase4:37767] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-17 12:11:02,019 DEBUG [RS:1;jenkins-hbase4:37767] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-17 12:11:02,019 DEBUG [RS:1;jenkins-hbase4:37767] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:02,019 DEBUG [RS:1;jenkins-hbase4:37767] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37767,1689595859826' 2023-07-17 12:11:02,019 DEBUG [RS:1;jenkins-hbase4:37767] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:02,020 DEBUG [RS:1;jenkins-hbase4:37767] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:02,020 DEBUG [RS:2;jenkins-hbase4:44163] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-17 12:11:02,020 DEBUG [RS:2;jenkins-hbase4:44163] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-17 12:11:02,021 DEBUG [RS:2;jenkins-hbase4:44163] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:02,021 DEBUG [RS:2;jenkins-hbase4:44163] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44163,1689595859880' 2023-07-17 12:11:02,021 DEBUG [RS:2;jenkins-hbase4:44163] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:02,021 DEBUG [RS:1;jenkins-hbase4:37767] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-17 12:11:02,021 INFO [RS:1;jenkins-hbase4:37767] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-17 12:11:02,022 INFO [RS:1;jenkins-hbase4:37767] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-17 12:11:02,027 DEBUG [RS:2;jenkins-hbase4:44163] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:02,028 DEBUG [RS:2;jenkins-hbase4:44163] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-17 12:11:02,028 INFO [RS:2;jenkins-hbase4:44163] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-17 12:11:02,028 INFO [RS:2;jenkins-hbase4:44163] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-17 12:11:02,127 INFO [RS:1;jenkins-hbase4:37767] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37767%2C1689595859826, suffix=, logDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/WALs/jenkins-hbase4.apache.org,37767,1689595859826, archiveDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/oldWALs, maxLogs=32 2023-07-17 12:11:02,131 INFO [RS:2;jenkins-hbase4:44163] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44163%2C1689595859880, suffix=, logDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/WALs/jenkins-hbase4.apache.org,44163,1689595859880, archiveDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/oldWALs, maxLogs=32 2023-07-17 12:11:02,133 INFO [RS:0;jenkins-hbase4:34107] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34107%2C1689595859757, suffix=, logDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/WALs/jenkins-hbase4.apache.org,34107,1689595859757, archiveDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/oldWALs, maxLogs=32 2023-07-17 12:11:02,192 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33975,DS-675a133a-dabe-46d7-b436-dab6d40745a7,DISK] 2023-07-17 12:11:02,193 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42061,DS-7e26a09b-f5a0-441a-ae20-3fc4e377a7ef,DISK] 2023-07-17 12:11:02,209 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37853,DS-23ddec88-0c8f-419a-aaa8-c58ea51cb0ad,DISK] 2023-07-17 12:11:02,210 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33975,DS-675a133a-dabe-46d7-b436-dab6d40745a7,DISK] 2023-07-17 12:11:02,214 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42061,DS-7e26a09b-f5a0-441a-ae20-3fc4e377a7ef,DISK] 2023-07-17 12:11:02,215 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33975,DS-675a133a-dabe-46d7-b436-dab6d40745a7,DISK] 2023-07-17 12:11:02,217 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37853,DS-23ddec88-0c8f-419a-aaa8-c58ea51cb0ad,DISK] 2023-07-17 12:11:02,219 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42061,DS-7e26a09b-f5a0-441a-ae20-3fc4e377a7ef,DISK] 2023-07-17 12:11:02,220 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37853,DS-23ddec88-0c8f-419a-aaa8-c58ea51cb0ad,DISK] 2023-07-17 12:11:02,215 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:02,225 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-17 12:11:02,234 INFO [RS:0;jenkins-hbase4:34107] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/WALs/jenkins-hbase4.apache.org,34107,1689595859757/jenkins-hbase4.apache.org%2C34107%2C1689595859757.1689595862135 2023-07-17 12:11:02,235 INFO [RS:1;jenkins-hbase4:37767] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/WALs/jenkins-hbase4.apache.org,37767,1689595859826/jenkins-hbase4.apache.org%2C37767%2C1689595859826.1689595862134 2023-07-17 12:11:02,237 DEBUG [RS:0;jenkins-hbase4:34107] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33975,DS-675a133a-dabe-46d7-b436-dab6d40745a7,DISK], DatanodeInfoWithStorage[127.0.0.1:42061,DS-7e26a09b-f5a0-441a-ae20-3fc4e377a7ef,DISK], DatanodeInfoWithStorage[127.0.0.1:37853,DS-23ddec88-0c8f-419a-aaa8-c58ea51cb0ad,DISK]] 2023-07-17 12:11:02,253 DEBUG [RS:1;jenkins-hbase4:37767] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33975,DS-675a133a-dabe-46d7-b436-dab6d40745a7,DISK], DatanodeInfoWithStorage[127.0.0.1:42061,DS-7e26a09b-f5a0-441a-ae20-3fc4e377a7ef,DISK], DatanodeInfoWithStorage[127.0.0.1:37853,DS-23ddec88-0c8f-419a-aaa8-c58ea51cb0ad,DISK]] 2023-07-17 12:11:02,255 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46742, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-17 12:11:02,258 INFO [RS:2;jenkins-hbase4:44163] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/WALs/jenkins-hbase4.apache.org,44163,1689595859880/jenkins-hbase4.apache.org%2C44163%2C1689595859880.1689595862135 2023-07-17 12:11:02,261 DEBUG [RS:2;jenkins-hbase4:44163] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37853,DS-23ddec88-0c8f-419a-aaa8-c58ea51cb0ad,DISK], DatanodeInfoWithStorage[127.0.0.1:42061,DS-7e26a09b-f5a0-441a-ae20-3fc4e377a7ef,DISK], DatanodeInfoWithStorage[127.0.0.1:33975,DS-675a133a-dabe-46d7-b436-dab6d40745a7,DISK]] 2023-07-17 12:11:02,275 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-17 12:11:02,276 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-17 12:11:02,280 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34107%2C1689595859757.meta, suffix=.meta, logDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/WALs/jenkins-hbase4.apache.org,34107,1689595859757, archiveDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/oldWALs, maxLogs=32 2023-07-17 12:11:02,317 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42061,DS-7e26a09b-f5a0-441a-ae20-3fc4e377a7ef,DISK] 2023-07-17 12:11:02,318 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33975,DS-675a133a-dabe-46d7-b436-dab6d40745a7,DISK] 2023-07-17 12:11:02,331 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37853,DS-23ddec88-0c8f-419a-aaa8-c58ea51cb0ad,DISK] 2023-07-17 12:11:02,344 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/WALs/jenkins-hbase4.apache.org,34107,1689595859757/jenkins-hbase4.apache.org%2C34107%2C1689595859757.meta.1689595862281.meta 2023-07-17 12:11:02,345 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33975,DS-675a133a-dabe-46d7-b436-dab6d40745a7,DISK], DatanodeInfoWithStorage[127.0.0.1:42061,DS-7e26a09b-f5a0-441a-ae20-3fc4e377a7ef,DISK], DatanodeInfoWithStorage[127.0.0.1:37853,DS-23ddec88-0c8f-419a-aaa8-c58ea51cb0ad,DISK]] 2023-07-17 12:11:02,345 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-17 12:11:02,347 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-17 12:11:02,348 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 12:11:02,349 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-17 12:11:02,351 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-17 12:11:02,352 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-17 12:11:02,368 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-17 12:11:02,368 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:11:02,368 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-17 12:11:02,368 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-17 12:11:02,379 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-17 12:11:02,384 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/hbase/meta/1588230740/info 2023-07-17 12:11:02,384 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/hbase/meta/1588230740/info 2023-07-17 12:11:02,385 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-17 12:11:02,386 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 12:11:02,386 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-17 12:11:02,388 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/hbase/meta/1588230740/rep_barrier 2023-07-17 12:11:02,388 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/hbase/meta/1588230740/rep_barrier 2023-07-17 12:11:02,389 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-17 12:11:02,390 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 12:11:02,390 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-17 12:11:02,392 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/hbase/meta/1588230740/table 2023-07-17 12:11:02,392 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/hbase/meta/1588230740/table 2023-07-17 12:11:02,392 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-17 12:11:02,393 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 12:11:02,395 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/hbase/meta/1588230740 2023-07-17 12:11:02,399 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/hbase/meta/1588230740 2023-07-17 12:11:02,403 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-17 12:11:02,406 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-17 12:11:02,408 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60222965, jitterRate=-0.10260789096355438}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-17 12:11:02,411 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-17 12:11:02,425 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689595862202 2023-07-17 12:11:02,449 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-17 12:11:02,450 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-17 12:11:02,451 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34107,1689595859757, state=OPEN 2023-07-17 12:11:02,457 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-17 12:11:02,457 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-17 12:11:02,462 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-17 12:11:02,463 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34107,1689595859757 in 459 msec 2023-07-17 12:11:02,470 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-17 12:11:02,470 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 712 msec 2023-07-17 12:11:02,475 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1380 sec 2023-07-17 12:11:02,476 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689595862475, completionTime=-1 2023-07-17 12:11:02,476 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-17 12:11:02,476 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-17 12:11:02,568 DEBUG [hconnection-0x24b8e848-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:11:02,575 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46744, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:11:02,605 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-17 12:11:02,606 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689595922606 2023-07-17 12:11:02,606 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689595982606 2023-07-17 12:11:02,606 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 129 msec 2023-07-17 12:11:02,658 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35573,1689595858202-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:02,658 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35573,1689595858202-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:02,658 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35573,1689595858202-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:02,661 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:35573, period=300000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:02,675 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-17 12:11:02,697 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-17 12:11:02,708 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-17 12:11:02,709 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-17 12:11:02,722 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-17 12:11:02,725 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 12:11:02,730 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 12:11:02,757 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/hbase/namespace/9053df43c9bd02edab5ac7066000f09f 2023-07-17 12:11:02,760 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/hbase/namespace/9053df43c9bd02edab5ac7066000f09f empty. 2023-07-17 12:11:02,761 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/hbase/namespace/9053df43c9bd02edab5ac7066000f09f 2023-07-17 12:11:02,761 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-17 12:11:02,817 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-17 12:11:02,820 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9053df43c9bd02edab5ac7066000f09f, NAME => 'hbase:namespace,,1689595862709.9053df43c9bd02edab5ac7066000f09f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp 2023-07-17 12:11:02,848 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689595862709.9053df43c9bd02edab5ac7066000f09f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:11:02,848 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 9053df43c9bd02edab5ac7066000f09f, disabling compactions & flushes 2023-07-17 12:11:02,848 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689595862709.9053df43c9bd02edab5ac7066000f09f. 2023-07-17 12:11:02,848 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689595862709.9053df43c9bd02edab5ac7066000f09f. 2023-07-17 12:11:02,848 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689595862709.9053df43c9bd02edab5ac7066000f09f. after waiting 0 ms 2023-07-17 12:11:02,848 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689595862709.9053df43c9bd02edab5ac7066000f09f. 2023-07-17 12:11:02,849 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689595862709.9053df43c9bd02edab5ac7066000f09f. 2023-07-17 12:11:02,849 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 9053df43c9bd02edab5ac7066000f09f: 2023-07-17 12:11:02,855 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 12:11:02,875 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689595862709.9053df43c9bd02edab5ac7066000f09f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689595862859"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595862859"}]},"ts":"1689595862859"} 2023-07-17 12:11:02,911 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-17 12:11:02,914 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 12:11:02,920 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595862914"}]},"ts":"1689595862914"} 2023-07-17 12:11:02,924 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-17 12:11:02,930 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 12:11:02,932 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 12:11:02,932 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 12:11:02,932 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 12:11:02,932 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 12:11:02,936 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=9053df43c9bd02edab5ac7066000f09f, ASSIGN}] 2023-07-17 12:11:02,942 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=9053df43c9bd02edab5ac7066000f09f, ASSIGN 2023-07-17 12:11:02,944 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=9053df43c9bd02edab5ac7066000f09f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37767,1689595859826; forceNewPlan=false, retain=false 2023-07-17 12:11:03,097 INFO [jenkins-hbase4:35573] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-17 12:11:03,098 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=9053df43c9bd02edab5ac7066000f09f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:03,098 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689595862709.9053df43c9bd02edab5ac7066000f09f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689595863098"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595863098"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595863098"}]},"ts":"1689595863098"} 2023-07-17 12:11:03,106 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 9053df43c9bd02edab5ac7066000f09f, server=jenkins-hbase4.apache.org,37767,1689595859826}] 2023-07-17 12:11:03,262 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:03,262 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-17 12:11:03,265 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55348, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-17 12:11:03,271 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689595862709.9053df43c9bd02edab5ac7066000f09f. 2023-07-17 12:11:03,271 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9053df43c9bd02edab5ac7066000f09f, NAME => 'hbase:namespace,,1689595862709.9053df43c9bd02edab5ac7066000f09f.', STARTKEY => '', ENDKEY => ''} 2023-07-17 12:11:03,271 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689595862709.9053df43c9bd02edab5ac7066000f09f. service=AccessControlService 2023-07-17 12:11:03,272 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 12:11:03,272 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 9053df43c9bd02edab5ac7066000f09f 2023-07-17 12:11:03,272 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689595862709.9053df43c9bd02edab5ac7066000f09f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:11:03,272 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9053df43c9bd02edab5ac7066000f09f 2023-07-17 12:11:03,272 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9053df43c9bd02edab5ac7066000f09f 2023-07-17 12:11:03,275 INFO [StoreOpener-9053df43c9bd02edab5ac7066000f09f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 9053df43c9bd02edab5ac7066000f09f 2023-07-17 12:11:03,277 DEBUG [StoreOpener-9053df43c9bd02edab5ac7066000f09f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/hbase/namespace/9053df43c9bd02edab5ac7066000f09f/info 2023-07-17 12:11:03,277 DEBUG [StoreOpener-9053df43c9bd02edab5ac7066000f09f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/hbase/namespace/9053df43c9bd02edab5ac7066000f09f/info 2023-07-17 12:11:03,278 INFO [StoreOpener-9053df43c9bd02edab5ac7066000f09f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9053df43c9bd02edab5ac7066000f09f columnFamilyName info 2023-07-17 12:11:03,279 INFO [StoreOpener-9053df43c9bd02edab5ac7066000f09f-1] regionserver.HStore(310): Store=9053df43c9bd02edab5ac7066000f09f/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 12:11:03,281 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/hbase/namespace/9053df43c9bd02edab5ac7066000f09f 2023-07-17 12:11:03,282 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/hbase/namespace/9053df43c9bd02edab5ac7066000f09f 2023-07-17 12:11:03,286 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9053df43c9bd02edab5ac7066000f09f 2023-07-17 12:11:03,289 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/hbase/namespace/9053df43c9bd02edab5ac7066000f09f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 12:11:03,290 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9053df43c9bd02edab5ac7066000f09f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66651501, jitterRate=-0.006815239787101746}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 12:11:03,290 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9053df43c9bd02edab5ac7066000f09f: 2023-07-17 12:11:03,292 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689595862709.9053df43c9bd02edab5ac7066000f09f., pid=6, masterSystemTime=1689595863262 2023-07-17 12:11:03,296 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689595862709.9053df43c9bd02edab5ac7066000f09f. 2023-07-17 12:11:03,297 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689595862709.9053df43c9bd02edab5ac7066000f09f. 2023-07-17 12:11:03,298 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=9053df43c9bd02edab5ac7066000f09f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:03,298 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689595862709.9053df43c9bd02edab5ac7066000f09f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689595863297"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689595863297"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689595863297"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689595863297"}]},"ts":"1689595863297"} 2023-07-17 12:11:03,305 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-17 12:11:03,305 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 9053df43c9bd02edab5ac7066000f09f, server=jenkins-hbase4.apache.org,37767,1689595859826 in 195 msec 2023-07-17 12:11:03,308 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-17 12:11:03,309 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=9053df43c9bd02edab5ac7066000f09f, ASSIGN in 369 msec 2023-07-17 12:11:03,310 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 12:11:03,310 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595863310"}]},"ts":"1689595863310"} 2023-07-17 12:11:03,315 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-17 12:11:03,318 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 12:11:03,322 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 608 msec 2023-07-17 12:11:03,325 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-17 12:11:03,326 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-17 12:11:03,326 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 12:11:03,350 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:11:03,356 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55354, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:11:03,372 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-17 12:11:03,395 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-17 12:11:03,404 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 40 msec 2023-07-17 12:11:03,417 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-17 12:11:03,431 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-17 12:11:03,436 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 19 msec 2023-07-17 12:11:03,444 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-17 12:11:03,446 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-17 12:11:03,447 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.472sec 2023-07-17 12:11:03,451 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-17 12:11:03,453 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-17 12:11:03,453 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-17 12:11:03,455 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35573,1689595858202-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-17 12:11:03,455 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35573,1689595858202-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-17 12:11:03,478 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-17 12:11:03,480 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-17 12:11:03,483 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 12:11:03,484 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 12:11:03,487 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-17 12:11:03,488 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/hbase/acl/5bddfb1236aca85b6b8a6c8b72c5e466 2023-07-17 12:11:03,489 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/hbase/acl/5bddfb1236aca85b6b8a6c8b72c5e466 empty. 2023-07-17 12:11:03,491 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/hbase/acl/5bddfb1236aca85b6b8a6c8b72c5e466 2023-07-17 12:11:03,491 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-17 12:11:03,496 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-17 12:11:03,525 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-17 12:11:03,531 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5bddfb1236aca85b6b8a6c8b72c5e466, NAME => 'hbase:acl,,1689595863473.5bddfb1236aca85b6b8a6c8b72c5e466.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp 2023-07-17 12:11:03,532 DEBUG [Listener at localhost/40159] zookeeper.ReadOnlyZKClient(139): Connect 0x3589465b to 127.0.0.1:60075 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:11:03,546 DEBUG [Listener at localhost/40159] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@731bcfb2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:11:03,587 DEBUG [hconnection-0x29046a5b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:11:03,595 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689595863473.5bddfb1236aca85b6b8a6c8b72c5e466.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:11:03,595 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 5bddfb1236aca85b6b8a6c8b72c5e466, disabling compactions & flushes 2023-07-17 12:11:03,595 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689595863473.5bddfb1236aca85b6b8a6c8b72c5e466. 2023-07-17 12:11:03,595 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689595863473.5bddfb1236aca85b6b8a6c8b72c5e466. 2023-07-17 12:11:03,595 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689595863473.5bddfb1236aca85b6b8a6c8b72c5e466. after waiting 0 ms 2023-07-17 12:11:03,595 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689595863473.5bddfb1236aca85b6b8a6c8b72c5e466. 2023-07-17 12:11:03,595 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689595863473.5bddfb1236aca85b6b8a6c8b72c5e466. 2023-07-17 12:11:03,595 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 5bddfb1236aca85b6b8a6c8b72c5e466: 2023-07-17 12:11:03,601 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 12:11:03,602 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-17 12:11:03,602 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689595863473.5bddfb1236aca85b6b8a6c8b72c5e466.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689595863602"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595863602"}]},"ts":"1689595863602"} 2023-07-17 12:11:03,607 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-17 12:11:03,609 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 12:11:03,609 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595863609"}]},"ts":"1689595863609"} 2023-07-17 12:11:03,611 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46748, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:11:03,613 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-17 12:11:03,614 INFO [Listener at localhost/40159] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,35573,1689595858202 2023-07-17 12:11:03,614 INFO [Listener at localhost/40159] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-17 12:11:03,614 INFO [Listener at localhost/40159] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/test.cache.data in system properties and HBase conf 2023-07-17 12:11:03,615 INFO [Listener at localhost/40159] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/hadoop.tmp.dir in system properties and HBase conf 2023-07-17 12:11:03,615 INFO [Listener at localhost/40159] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/hadoop.log.dir in system properties and HBase conf 2023-07-17 12:11:03,615 INFO [Listener at localhost/40159] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-17 12:11:03,615 INFO [Listener at localhost/40159] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-17 12:11:03,615 INFO [Listener at localhost/40159] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-17 12:11:03,616 INFO [Listener at localhost/40159] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-17 12:11:03,616 INFO [Listener at localhost/40159] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-17 12:11:03,616 INFO [Listener at localhost/40159] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-17 12:11:03,616 INFO [Listener at localhost/40159] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-17 12:11:03,616 INFO [Listener at localhost/40159] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-17 12:11:03,616 INFO [Listener at localhost/40159] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-17 12:11:03,616 INFO [Listener at localhost/40159] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-17 12:11:03,617 INFO [Listener at localhost/40159] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-17 12:11:03,617 INFO [Listener at localhost/40159] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-17 12:11:03,617 INFO [Listener at localhost/40159] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/nfs.dump.dir in system properties and HBase conf 2023-07-17 12:11:03,617 INFO [Listener at localhost/40159] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/java.io.tmpdir in system properties and HBase conf 2023-07-17 12:11:03,617 INFO [Listener at localhost/40159] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-17 12:11:03,617 INFO [Listener at localhost/40159] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-17 12:11:03,617 INFO [Listener at localhost/40159] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-17 12:11:03,619 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 12:11:03,621 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 12:11:03,621 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 12:11:03,621 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 12:11:03,621 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 12:11:03,621 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=5bddfb1236aca85b6b8a6c8b72c5e466, ASSIGN}] 2023-07-17 12:11:03,626 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=5bddfb1236aca85b6b8a6c8b72c5e466, ASSIGN 2023-07-17 12:11:03,627 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=5bddfb1236aca85b6b8a6c8b72c5e466, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44163,1689595859880; forceNewPlan=false, retain=false 2023-07-17 12:11:03,778 INFO [jenkins-hbase4:35573] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-17 12:11:03,779 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=5bddfb1236aca85b6b8a6c8b72c5e466, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:03,779 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689595863473.5bddfb1236aca85b6b8a6c8b72c5e466.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689595863779"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595863779"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595863779"}]},"ts":"1689595863779"} 2023-07-17 12:11:03,783 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 5bddfb1236aca85b6b8a6c8b72c5e466, server=jenkins-hbase4.apache.org,44163,1689595859880}] 2023-07-17 12:11:03,802 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-17 12:11:03,940 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:03,940 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-17 12:11:03,942 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42554, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-17 12:11:03,948 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689595863473.5bddfb1236aca85b6b8a6c8b72c5e466. 2023-07-17 12:11:03,948 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5bddfb1236aca85b6b8a6c8b72c5e466, NAME => 'hbase:acl,,1689595863473.5bddfb1236aca85b6b8a6c8b72c5e466.', STARTKEY => '', ENDKEY => ''} 2023-07-17 12:11:03,949 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689595863473.5bddfb1236aca85b6b8a6c8b72c5e466. service=AccessControlService 2023-07-17 12:11:03,949 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 12:11:03,949 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 5bddfb1236aca85b6b8a6c8b72c5e466 2023-07-17 12:11:03,949 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689595863473.5bddfb1236aca85b6b8a6c8b72c5e466.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:11:03,949 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5bddfb1236aca85b6b8a6c8b72c5e466 2023-07-17 12:11:03,949 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5bddfb1236aca85b6b8a6c8b72c5e466 2023-07-17 12:11:03,951 INFO [StoreOpener-5bddfb1236aca85b6b8a6c8b72c5e466-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 5bddfb1236aca85b6b8a6c8b72c5e466 2023-07-17 12:11:03,954 DEBUG [StoreOpener-5bddfb1236aca85b6b8a6c8b72c5e466-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/hbase/acl/5bddfb1236aca85b6b8a6c8b72c5e466/l 2023-07-17 12:11:03,954 DEBUG [StoreOpener-5bddfb1236aca85b6b8a6c8b72c5e466-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/hbase/acl/5bddfb1236aca85b6b8a6c8b72c5e466/l 2023-07-17 12:11:03,954 INFO [StoreOpener-5bddfb1236aca85b6b8a6c8b72c5e466-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5bddfb1236aca85b6b8a6c8b72c5e466 columnFamilyName l 2023-07-17 12:11:03,955 INFO [StoreOpener-5bddfb1236aca85b6b8a6c8b72c5e466-1] regionserver.HStore(310): Store=5bddfb1236aca85b6b8a6c8b72c5e466/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 12:11:03,957 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/hbase/acl/5bddfb1236aca85b6b8a6c8b72c5e466 2023-07-17 12:11:03,959 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/hbase/acl/5bddfb1236aca85b6b8a6c8b72c5e466 2023-07-17 12:11:03,968 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5bddfb1236aca85b6b8a6c8b72c5e466 2023-07-17 12:11:03,973 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/hbase/acl/5bddfb1236aca85b6b8a6c8b72c5e466/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 12:11:03,974 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5bddfb1236aca85b6b8a6c8b72c5e466; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75335637, jitterRate=0.12258847057819366}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 12:11:03,975 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5bddfb1236aca85b6b8a6c8b72c5e466: 2023-07-17 12:11:03,980 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689595863473.5bddfb1236aca85b6b8a6c8b72c5e466., pid=11, masterSystemTime=1689595863940 2023-07-17 12:11:03,985 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689595863473.5bddfb1236aca85b6b8a6c8b72c5e466. 2023-07-17 12:11:03,986 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689595863473.5bddfb1236aca85b6b8a6c8b72c5e466. 2023-07-17 12:11:03,988 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=5bddfb1236aca85b6b8a6c8b72c5e466, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:03,988 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689595863473.5bddfb1236aca85b6b8a6c8b72c5e466.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689595863988"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689595863988"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689595863988"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689595863988"}]},"ts":"1689595863988"} 2023-07-17 12:11:03,997 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-17 12:11:03,998 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 5bddfb1236aca85b6b8a6c8b72c5e466, server=jenkins-hbase4.apache.org,44163,1689595859880 in 209 msec 2023-07-17 12:11:04,002 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-17 12:11:04,003 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=5bddfb1236aca85b6b8a6c8b72c5e466, ASSIGN in 377 msec 2023-07-17 12:11:04,004 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 12:11:04,004 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595864004"}]},"ts":"1689595864004"} 2023-07-17 12:11:04,007 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-17 12:11:04,010 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 12:11:04,013 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 532 msec 2023-07-17 12:11:04,103 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-17 12:11:04,103 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-17 12:11:04,119 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-17 12:11:04,987 WARN [Thread-382] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 12:11:05,294 INFO [Thread-382] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 12:11:05,300 INFO [Thread-382] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_38759_jobhistory____.9to62p/webapp 2023-07-17 12:11:05,461 INFO [Thread-382] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-17 12:11:05,462 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-17 12:11:05,462 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-17 12:11:05,464 INFO [Thread-382] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-17 12:11:05,543 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 12:11:05,828 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 12:11:06,143 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-17 12:11:06,230 INFO [Thread-382] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:38759 2023-07-17 12:11:06,481 WARN [Listener at jenkins-hbase4.apache.org/41009] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 12:11:06,916 WARN [Listener at jenkins-hbase4.apache.org/41009] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-17 12:11:06,917 INFO [Listener at jenkins-hbase4.apache.org/41009] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 12:11:06,936 INFO [Listener at jenkins-hbase4.apache.org/41009] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_44133_cluster____.kz0dzh/webapp 2023-07-17 12:11:07,052 INFO [Listener at jenkins-hbase4.apache.org/41009] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-17 12:11:07,052 INFO [Listener at jenkins-hbase4.apache.org/41009] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-17 12:11:07,052 INFO [Listener at jenkins-hbase4.apache.org/41009] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-17 12:11:07,053 INFO [Listener at jenkins-hbase4.apache.org/41009] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-17 12:11:07,065 INFO [Listener at jenkins-hbase4.apache.org/41009] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 12:11:07,318 INFO [Listener at jenkins-hbase4.apache.org/41009] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 12:11:07,608 INFO [Listener at jenkins-hbase4.apache.org/41009] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 12:11:07,667 INFO [Listener at jenkins-hbase4.apache.org/41009] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:44133 2023-07-17 12:11:08,066 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 12:11:08,221 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-17 12:11:08,222 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-17 12:11:08,223 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-17 12:11:08,380 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:11:08,381 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-17 12:11:08,381 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:11:08,381 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-17 12:11:08,382 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-17 12:11:08,382 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-17 12:11:08,382 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:11:08,382 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-17 12:11:08,382 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-17 12:11:08,382 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-17 12:11:08,518 WARN [Listener at jenkins-hbase4.apache.org/45687] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 12:11:08,545 WARN [Listener at jenkins-hbase4.apache.org/45687] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-17 12:11:08,546 INFO [Listener at jenkins-hbase4.apache.org/45687] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 12:11:08,555 INFO [Listener at jenkins-hbase4.apache.org/45687] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_42343_node____1chvxu/webapp 2023-07-17 12:11:08,617 INFO [Listener at jenkins-hbase4.apache.org/45687] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-17 12:11:08,618 INFO [Listener at jenkins-hbase4.apache.org/45687] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-17 12:11:08,618 INFO [Listener at jenkins-hbase4.apache.org/45687] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-17 12:11:08,618 INFO [Listener at jenkins-hbase4.apache.org/45687] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-17 12:11:08,626 INFO [Listener at jenkins-hbase4.apache.org/45687] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 12:11:08,650 INFO [Listener at jenkins-hbase4.apache.org/45687] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 12:11:08,732 INFO [Listener at jenkins-hbase4.apache.org/45687] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 12:11:08,746 INFO [Listener at jenkins-hbase4.apache.org/45687] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:42343 2023-07-17 12:11:08,950 WARN [Listener at jenkins-hbase4.apache.org/42275] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 12:11:08,958 WARN [Listener at jenkins-hbase4.apache.org/42275] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-17 12:11:08,958 INFO [Listener at jenkins-hbase4.apache.org/42275] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 12:11:08,966 INFO [Listener at jenkins-hbase4.apache.org/42275] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_45651_node____.ovaob5/webapp 2023-07-17 12:11:09,023 INFO [Listener at jenkins-hbase4.apache.org/42275] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-17 12:11:09,023 INFO [Listener at jenkins-hbase4.apache.org/42275] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-17 12:11:09,023 INFO [Listener at jenkins-hbase4.apache.org/42275] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-17 12:11:09,023 INFO [Listener at jenkins-hbase4.apache.org/42275] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-17 12:11:09,030 INFO [Listener at jenkins-hbase4.apache.org/42275] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 12:11:09,043 INFO [Listener at jenkins-hbase4.apache.org/42275] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 12:11:09,129 INFO [Listener at jenkins-hbase4.apache.org/42275] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 12:11:09,136 INFO [Listener at jenkins-hbase4.apache.org/42275] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:45651 2023-07-17 12:11:09,161 INFO [Listener at jenkins-hbase4.apache.org/42275] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-17 12:11:09,163 INFO [Listener at jenkins-hbase4.apache.org/42275] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 12:11:09,242 INFO [Listener at jenkins-hbase4.apache.org/42275] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=710, OpenFileDescriptor=900, MaxFileDescriptor=60000, SystemLoadAverage=403, ProcessCount=174, AvailableMemoryMB=4915 2023-07-17 12:11:09,243 WARN [Listener at jenkins-hbase4.apache.org/42275] hbase.ResourceChecker(130): Thread=710 is superior to 500 2023-07-17 12:11:09,259 DEBUG [Listener at jenkins-hbase4.apache.org/42275] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-17 12:11:09,266 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45022, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-17 12:11:09,273 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-17 12:11:09,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-17 12:11:09,280 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 12:11:09,280 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-17 12:11:09,282 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 12:11:09,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-17 12:11:09,290 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportWithTargetName/5b710b6235e67d124d6af94fba90c29e 2023-07-17 12:11:09,290 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportWithTargetName/e519d10bc3f6ef9d04a098ffce068501 2023-07-17 12:11:09,292 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportWithTargetName/e519d10bc3f6ef9d04a098ffce068501 empty. 2023-07-17 12:11:09,292 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportWithTargetName/5b710b6235e67d124d6af94fba90c29e empty. 2023-07-17 12:11:09,293 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportWithTargetName/e519d10bc3f6ef9d04a098ffce068501 2023-07-17 12:11:09,294 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportWithTargetName/5b710b6235e67d124d6af94fba90c29e 2023-07-17 12:11:09,294 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-17 12:11:09,327 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-17 12:11:09,330 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => e519d10bc3f6ef9d04a098ffce068501, NAME => 'testtb-testExportWithTargetName,1,1689595869273.e519d10bc3f6ef9d04a098ffce068501.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp 2023-07-17 12:11:09,330 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5b710b6235e67d124d6af94fba90c29e, NAME => 'testtb-testExportWithTargetName,,1689595869273.5b710b6235e67d124d6af94fba90c29e.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp 2023-07-17 12:11:09,386 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689595869273.e519d10bc3f6ef9d04a098ffce068501.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:11:09,387 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing e519d10bc3f6ef9d04a098ffce068501, disabling compactions & flushes 2023-07-17 12:11:09,388 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689595869273.e519d10bc3f6ef9d04a098ffce068501. 2023-07-17 12:11:09,388 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689595869273.e519d10bc3f6ef9d04a098ffce068501. 2023-07-17 12:11:09,388 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689595869273.e519d10bc3f6ef9d04a098ffce068501. after waiting 0 ms 2023-07-17 12:11:09,388 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689595869273.e519d10bc3f6ef9d04a098ffce068501. 2023-07-17 12:11:09,388 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689595869273.e519d10bc3f6ef9d04a098ffce068501. 2023-07-17 12:11:09,388 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for e519d10bc3f6ef9d04a098ffce068501: 2023-07-17 12:11:09,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-17 12:11:09,391 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689595869273.5b710b6235e67d124d6af94fba90c29e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:11:09,396 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 5b710b6235e67d124d6af94fba90c29e, disabling compactions & flushes 2023-07-17 12:11:09,398 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689595869273.5b710b6235e67d124d6af94fba90c29e. 2023-07-17 12:11:09,398 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689595869273.5b710b6235e67d124d6af94fba90c29e. 2023-07-17 12:11:09,398 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689595869273.5b710b6235e67d124d6af94fba90c29e. after waiting 0 ms 2023-07-17 12:11:09,398 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689595869273.5b710b6235e67d124d6af94fba90c29e. 2023-07-17 12:11:09,398 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689595869273.5b710b6235e67d124d6af94fba90c29e. 2023-07-17 12:11:09,398 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 5b710b6235e67d124d6af94fba90c29e: 2023-07-17 12:11:09,403 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 12:11:09,404 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689595869273.e519d10bc3f6ef9d04a098ffce068501.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689595869404"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595869404"}]},"ts":"1689595869404"} 2023-07-17 12:11:09,404 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689595869273.5b710b6235e67d124d6af94fba90c29e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689595869404"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595869404"}]},"ts":"1689595869404"} 2023-07-17 12:11:09,460 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-17 12:11:09,462 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 12:11:09,462 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595869462"}]},"ts":"1689595869462"} 2023-07-17 12:11:09,464 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-17 12:11:09,469 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 12:11:09,471 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 12:11:09,471 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 12:11:09,471 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 12:11:09,471 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 12:11:09,471 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5b710b6235e67d124d6af94fba90c29e, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e519d10bc3f6ef9d04a098ffce068501, ASSIGN}] 2023-07-17 12:11:09,474 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e519d10bc3f6ef9d04a098ffce068501, ASSIGN 2023-07-17 12:11:09,474 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5b710b6235e67d124d6af94fba90c29e, ASSIGN 2023-07-17 12:11:09,475 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5b710b6235e67d124d6af94fba90c29e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44163,1689595859880; forceNewPlan=false, retain=false 2023-07-17 12:11:09,475 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e519d10bc3f6ef9d04a098ffce068501, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37767,1689595859826; forceNewPlan=false, retain=false 2023-07-17 12:11:09,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-17 12:11:09,626 INFO [jenkins-hbase4:35573] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-17 12:11:09,628 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=e519d10bc3f6ef9d04a098ffce068501, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:09,628 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=5b710b6235e67d124d6af94fba90c29e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:09,628 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689595869273.e519d10bc3f6ef9d04a098ffce068501.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689595869628"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595869628"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595869628"}]},"ts":"1689595869628"} 2023-07-17 12:11:09,628 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689595869273.5b710b6235e67d124d6af94fba90c29e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689595869628"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595869628"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595869628"}]},"ts":"1689595869628"} 2023-07-17 12:11:09,631 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure e519d10bc3f6ef9d04a098ffce068501, server=jenkins-hbase4.apache.org,37767,1689595859826}] 2023-07-17 12:11:09,633 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 5b710b6235e67d124d6af94fba90c29e, server=jenkins-hbase4.apache.org,44163,1689595859880}] 2023-07-17 12:11:09,790 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689595869273.e519d10bc3f6ef9d04a098ffce068501. 2023-07-17 12:11:09,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e519d10bc3f6ef9d04a098ffce068501, NAME => 'testtb-testExportWithTargetName,1,1689595869273.e519d10bc3f6ef9d04a098ffce068501.', STARTKEY => '1', ENDKEY => ''} 2023-07-17 12:11:09,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689595869273.e519d10bc3f6ef9d04a098ffce068501. service=AccessControlService 2023-07-17 12:11:09,791 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 12:11:09,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName e519d10bc3f6ef9d04a098ffce068501 2023-07-17 12:11:09,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689595869273.e519d10bc3f6ef9d04a098ffce068501.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:11:09,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e519d10bc3f6ef9d04a098ffce068501 2023-07-17 12:11:09,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e519d10bc3f6ef9d04a098ffce068501 2023-07-17 12:11:09,792 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689595869273.5b710b6235e67d124d6af94fba90c29e. 2023-07-17 12:11:09,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5b710b6235e67d124d6af94fba90c29e, NAME => 'testtb-testExportWithTargetName,,1689595869273.5b710b6235e67d124d6af94fba90c29e.', STARTKEY => '', ENDKEY => '1'} 2023-07-17 12:11:09,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689595869273.5b710b6235e67d124d6af94fba90c29e. service=AccessControlService 2023-07-17 12:11:09,793 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 12:11:09,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 5b710b6235e67d124d6af94fba90c29e 2023-07-17 12:11:09,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689595869273.5b710b6235e67d124d6af94fba90c29e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:11:09,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5b710b6235e67d124d6af94fba90c29e 2023-07-17 12:11:09,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5b710b6235e67d124d6af94fba90c29e 2023-07-17 12:11:09,794 INFO [StoreOpener-e519d10bc3f6ef9d04a098ffce068501-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e519d10bc3f6ef9d04a098ffce068501 2023-07-17 12:11:09,796 INFO [StoreOpener-5b710b6235e67d124d6af94fba90c29e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5b710b6235e67d124d6af94fba90c29e 2023-07-17 12:11:09,797 DEBUG [StoreOpener-e519d10bc3f6ef9d04a098ffce068501-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportWithTargetName/e519d10bc3f6ef9d04a098ffce068501/cf 2023-07-17 12:11:09,797 DEBUG [StoreOpener-e519d10bc3f6ef9d04a098ffce068501-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportWithTargetName/e519d10bc3f6ef9d04a098ffce068501/cf 2023-07-17 12:11:09,797 INFO [StoreOpener-e519d10bc3f6ef9d04a098ffce068501-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e519d10bc3f6ef9d04a098ffce068501 columnFamilyName cf 2023-07-17 12:11:09,798 DEBUG [StoreOpener-5b710b6235e67d124d6af94fba90c29e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportWithTargetName/5b710b6235e67d124d6af94fba90c29e/cf 2023-07-17 12:11:09,798 DEBUG [StoreOpener-5b710b6235e67d124d6af94fba90c29e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportWithTargetName/5b710b6235e67d124d6af94fba90c29e/cf 2023-07-17 12:11:09,798 INFO [StoreOpener-e519d10bc3f6ef9d04a098ffce068501-1] regionserver.HStore(310): Store=e519d10bc3f6ef9d04a098ffce068501/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 12:11:09,800 INFO [StoreOpener-5b710b6235e67d124d6af94fba90c29e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5b710b6235e67d124d6af94fba90c29e columnFamilyName cf 2023-07-17 12:11:09,801 INFO [StoreOpener-5b710b6235e67d124d6af94fba90c29e-1] regionserver.HStore(310): Store=5b710b6235e67d124d6af94fba90c29e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 12:11:09,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportWithTargetName/e519d10bc3f6ef9d04a098ffce068501 2023-07-17 12:11:09,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportWithTargetName/e519d10bc3f6ef9d04a098ffce068501 2023-07-17 12:11:09,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportWithTargetName/5b710b6235e67d124d6af94fba90c29e 2023-07-17 12:11:09,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportWithTargetName/5b710b6235e67d124d6af94fba90c29e 2023-07-17 12:11:09,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e519d10bc3f6ef9d04a098ffce068501 2023-07-17 12:11:09,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5b710b6235e67d124d6af94fba90c29e 2023-07-17 12:11:09,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportWithTargetName/e519d10bc3f6ef9d04a098ffce068501/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 12:11:09,838 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e519d10bc3f6ef9d04a098ffce068501; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73043320, jitterRate=0.08843028545379639}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 12:11:09,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e519d10bc3f6ef9d04a098ffce068501: 2023-07-17 12:11:09,841 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689595869273.e519d10bc3f6ef9d04a098ffce068501., pid=15, masterSystemTime=1689595869784 2023-07-17 12:11:09,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689595869273.e519d10bc3f6ef9d04a098ffce068501. 2023-07-17 12:11:09,844 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689595869273.e519d10bc3f6ef9d04a098ffce068501. 2023-07-17 12:11:09,845 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=e519d10bc3f6ef9d04a098ffce068501, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:09,845 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689595869273.e519d10bc3f6ef9d04a098ffce068501.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689595869844"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689595869844"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689595869844"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689595869844"}]},"ts":"1689595869844"} 2023-07-17 12:11:09,853 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-17 12:11:09,853 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure e519d10bc3f6ef9d04a098ffce068501, server=jenkins-hbase4.apache.org,37767,1689595859826 in 217 msec 2023-07-17 12:11:09,855 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e519d10bc3f6ef9d04a098ffce068501, ASSIGN in 382 msec 2023-07-17 12:11:09,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportWithTargetName/5b710b6235e67d124d6af94fba90c29e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 12:11:09,861 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5b710b6235e67d124d6af94fba90c29e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60669456, jitterRate=-0.09595465660095215}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 12:11:09,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5b710b6235e67d124d6af94fba90c29e: 2023-07-17 12:11:09,862 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689595869273.5b710b6235e67d124d6af94fba90c29e., pid=16, masterSystemTime=1689595869785 2023-07-17 12:11:09,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689595869273.5b710b6235e67d124d6af94fba90c29e. 2023-07-17 12:11:09,866 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689595869273.5b710b6235e67d124d6af94fba90c29e. 2023-07-17 12:11:09,868 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=5b710b6235e67d124d6af94fba90c29e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:09,868 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689595869273.5b710b6235e67d124d6af94fba90c29e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689595869867"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689595869867"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689595869867"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689595869867"}]},"ts":"1689595869867"} 2023-07-17 12:11:09,875 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-17 12:11:09,875 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 5b710b6235e67d124d6af94fba90c29e, server=jenkins-hbase4.apache.org,44163,1689595859880 in 238 msec 2023-07-17 12:11:09,878 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-17 12:11:09,880 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5b710b6235e67d124d6af94fba90c29e, ASSIGN in 404 msec 2023-07-17 12:11:09,882 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 12:11:09,882 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595869882"}]},"ts":"1689595869882"} 2023-07-17 12:11:09,885 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-17 12:11:09,889 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 12:11:09,896 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-17 12:11:09,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-17 12:11:09,904 DEBUG [PEWorker-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:11:09,907 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42560, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:11:09,912 DEBUG [hconnection-0x48e23f29-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:11:09,915 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46764, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=ClientService 2023-07-17 12:11:09,924 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44163] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-17 12:11:09,960 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-17 12:11:09,960 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-17 12:11:09,960 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 12:11:09,960 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-17 12:11:09,960 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-17 12:11:09,970 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-17 12:11:09,970 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-17 12:11:09,971 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-17 12:11:09,971 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-17 12:11:09,972 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-17 12:11:09,972 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-17 12:11:09,975 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 698 msec 2023-07-17 12:11:10,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-17 12:11:10,406 INFO [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-17 12:11:10,406 DEBUG [Listener at jenkins-hbase4.apache.org/42275] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-17 12:11:10,407 INFO [Listener at jenkins-hbase4.apache.org/42275] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 12:11:10,413 INFO [Listener at jenkins-hbase4.apache.org/42275] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-17 12:11:10,414 INFO [Listener at jenkins-hbase4.apache.org/42275] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 12:11:10,414 INFO [Listener at jenkins-hbase4.apache.org/42275] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-17 12:11:10,428 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-17 12:11:10,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689595870428 (current time:1689595870428). 2023-07-17 12:11:10,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 12:11:10,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(139): Connect 0x485db17b to 127.0.0.1:60075 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:11:10,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22a396ae, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:11:10,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:11:10,439 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39244, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:11:10,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x485db17b to 127.0.0.1:60075 2023-07-17 12:11:10,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:11:10,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(139): Connect 0x779b6074 to 127.0.0.1:60075 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:11:10,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13aaa5f1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:11:10,450 DEBUG [hconnection-0xe9e0af4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:11:10,451 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39256, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:11:10,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:11:10,458 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39972, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:11:10,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x779b6074 to 127.0.0.1:60075 2023-07-17 12:11:10,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:11:10,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-17 12:11:10,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 12:11:10,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-17 12:11:10,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-17 12:11:10,510 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-17 12:11:10,512 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689596470512 2023-07-17 12:11:10,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-17 12:11:10,515 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-17 12:11:10,517 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-17 12:11:10,520 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-17 12:11:10,520 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 18 msec 2023-07-17 12:11:10,521 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-17 12:11:10,522 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689596470522 2023-07-17 12:11:10,524 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 12:11:10,524 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 12:11:10,555 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,559 INFO [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-17 12:11:10,559 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:11:10,560 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-17 12:11:10,560 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-17 12:11:10,561 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,561 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,566 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:10,566 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:10,566 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:10,566 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:10,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:10,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:10,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:10,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:10,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:10,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:10,566 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:10,567 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:10,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,567 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:10,567 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 12:11:10,567 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,567 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,567 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-17 12:11:10,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-17 12:11:10,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-17 12:11:10,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,568 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-17 12:11:10,568 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-17 12:11:10,568 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-17 12:11:10,571 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,571 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,571 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,571 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-17 12:11:10,571 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-17 12:11:10,571 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:11:10,571 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:11:10,573 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-17 12:11:10,573 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-17 12:11:10,573 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-17 12:11:10,571 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-17 12:11:10,573 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37767,1689595859826' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-17 12:11:10,574 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:11:10,573 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-17 12:11:10,575 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-17 12:11:10,575 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-17 12:11:10,575 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44163,1689595859880' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-17 12:11:10,575 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34107,1689595859757' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-17 12:11:10,578 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,578 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:10,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:10,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:10,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:10,578 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,578 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,578 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:10,579 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:10,578 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:11:10,582 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:10,582 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:11:10,582 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,582 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:11:10,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:10,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:10,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:10,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:10,584 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44163,1689595859880' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-17 12:11:10,584 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@741c5c21[Count = 1] remaining members to acquire global barrier 2023-07-17 12:11:10,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:10,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:10,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:10,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:10,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:10,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:10,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:10,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:10,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:10,587 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37767,1689595859826' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-17 12:11:10,587 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@741c5c21[Count = 0] remaining members to acquire global barrier 2023-07-17 12:11:10,587 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-17 12:11:10,587 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,591 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,591 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,591 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,592 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-17 12:11:10,592 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-17 12:11:10,592 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34107,1689595859757' in zk 2023-07-17 12:11:10,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,592 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-17 12:11:10,593 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-17 12:11:10,594 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:11:10,594 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:11:10,594 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689595869273.5b710b6235e67d124d6af94fba90c29e. 2023-07-17 12:11:10,594 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689595869273.5b710b6235e67d124d6af94fba90c29e. started... 2023-07-17 12:11:10,595 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:11:10,595 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689595869273.e519d10bc3f6ef9d04a098ffce068501. 2023-07-17 12:11:10,595 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:11:10,596 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-17 12:11:10,596 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:11:10,596 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689595869273.e519d10bc3f6ef9d04a098ffce068501. started... 2023-07-17 12:11:10,596 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-17 12:11:10,597 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:10,598 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:10,598 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 12:11:10,600 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e519d10bc3f6ef9d04a098ffce068501: 2023-07-17 12:11:10,600 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5b710b6235e67d124d6af94fba90c29e: 2023-07-17 12:11:10,601 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689595869273.e519d10bc3f6ef9d04a098ffce068501.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,601 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689595869273.5b710b6235e67d124d6af94fba90c29e.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,606 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:11:10,606 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:11:10,610 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 12:11:10,610 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 12:11:10,624 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:11:10,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-17 12:11:10,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:11:10,630 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 12:11:10,668 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689595869273.5b710b6235e67d124d6af94fba90c29e. completed. 2023-07-17 12:11:10,668 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689595869273.5b710b6235e67d124d6af94fba90c29e. 2023-07-17 12:11:10,668 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689595869273.e519d10bc3f6ef9d04a098ffce068501. completed. 2023-07-17 12:11:10,669 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689595869273.e519d10bc3f6ef9d04a098ffce068501. 2023-07-17 12:11:10,669 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:11:10,669 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:11:10,669 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:11:10,669 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:11:10,669 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:10,669 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:10,669 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-17 12:11:10,669 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-17 12:11:10,669 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44163,1689595859880' in zk 2023-07-17 12:11:10,669 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37767,1689595859826' in zk 2023-07-17 12:11:10,679 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-17 12:11:10,679 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-17 12:11:10,679 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:11:10,679 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-17 12:11:10,679 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:10,679 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:11:10,680 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:10,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:10,680 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-17 12:11:10,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:10,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:10,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:10,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:10,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:10,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:10,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:10,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:10,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:10,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:10,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:10,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,37767,1689595859826': 2023-07-17 12:11:10,690 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37767,1689595859826' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-17 12:11:10,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:10,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:10,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:10,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:10,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:10,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:10,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:10,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:10,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:10,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:10,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:10,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:10,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,44163,1689595859880': 2023-07-17 12:11:10,696 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44163,1689595859880' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-17 12:11:10,696 INFO [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-17 12:11:10,696 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 12:11:10,696 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 12:11:10,696 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,696 INFO [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 12:11:10,700 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,700 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:10,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:10,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,700 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:10,700 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,700 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,701 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:10,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,701 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:10,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:10,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:10,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:10,702 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:10,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:10,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:10,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:10,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:10,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,702 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:10,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:10,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,703 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:10,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:10,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:10,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:10,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:10,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,706 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:10,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:10,707 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:10,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:10,710 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:10,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:10,726 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:10,726 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:10,726 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:10,726 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:10,726 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:10,726 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:10,726 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,727 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,726 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:10,726 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:10,729 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:10,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:10,726 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:11:10,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:10,729 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:10,729 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,729 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:10,729 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:10,730 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,730 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,729 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:10,726 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:10,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:10,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:10,730 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:10,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:10,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:10,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:10,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:10,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:10,831 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:11:10,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-17 12:11:10,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:11:10,832 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,833 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 12:11:10,899 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-17 12:11:10,900 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,900 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:10,901 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689595870515Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689595870727 (+212 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689595870727Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689595870776 (+49 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689595870817 (+41 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689595870899 (+82 ms) 2023-07-17 12:11:10,902 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-17 12:11:10,905 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 384 msec 2023-07-17 12:11:11,133 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:11:11,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-17 12:11:11,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 12:11:11,157 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:11:11,157 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:11:11,164 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39988, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:11:11,165 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59032, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:11:11,165 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44163] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689595869273.5b710b6235e67d124d6af94fba90c29e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 12:11:11,167 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37767] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689595869273.e519d10bc3f6ef9d04a098ffce068501. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 12:11:11,174 DEBUG [Listener at jenkins-hbase4.apache.org/42275] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-17 12:11:11,176 DEBUG [Listener at jenkins-hbase4.apache.org/42275] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689595869273.5b710b6235e67d124d6af94fba90c29e. 2023-07-17 12:11:11,178 INFO [Listener at jenkins-hbase4.apache.org/42275] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 12:11:11,206 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-17 12:11:11,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689595871206 (current time:1689595871206). 2023-07-17 12:11:11,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 12:11:11,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(139): Connect 0x69347da3 to 127.0.0.1:60075 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:11:11,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a6efe75, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:11:11,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:11:11,218 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39262, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:11:11,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x69347da3 to 127.0.0.1:60075 2023-07-17 12:11:11,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:11:11,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(139): Connect 0x65d6dc9e to 127.0.0.1:60075 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:11:11,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f456ce2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:11:11,228 DEBUG [hconnection-0x32c5a229-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:11:11,231 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39264, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:11:11,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:11:11,236 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40000, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:11:11,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x65d6dc9e to 127.0.0.1:60075 2023-07-17 12:11:11,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:11:11,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-17 12:11:11,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 12:11:11,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-17 12:11:11,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-17 12:11:11,244 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-17 12:11:11,245 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689596471245 2023-07-17 12:11:11,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-17 12:11:11,245 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-17 12:11:11,247 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 12:11:11,247 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 12:11:11,248 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-17 12:11:11,249 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-17 12:11:11,254 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 8 msec 2023-07-17 12:11:11,255 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-17 12:11:11,256 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689596471256 2023-07-17 12:11:11,282 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-17 12:11:11,283 INFO [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-17 12:11:11,283 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:11:11,284 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-17 12:11:11,284 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-17 12:11:11,285 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,285 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,288 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:11,288 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:11,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:11,288 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:11,288 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:11,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:11,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:11,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:11,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:11,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:11,289 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:11,289 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:11,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,289 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:11,289 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 12:11:11,290 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,290 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-17 12:11:11,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,290 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,291 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-17 12:11:11,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-17 12:11:11,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,291 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-17 12:11:11,291 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-17 12:11:11,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-17 12:11:11,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,291 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-17 12:11:11,291 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-17 12:11:11,291 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-17 12:11:11,291 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-17 12:11:11,292 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:11:11,291 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:11:11,293 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-17 12:11:11,294 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-17 12:11:11,294 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-17 12:11:11,294 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:11:11,293 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-17 12:11:11,295 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-17 12:11:11,295 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34107,1689595859757' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-17 12:11:11,294 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-17 12:11:11,296 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-17 12:11:11,296 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37767,1689595859826' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-17 12:11:11,296 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-17 12:11:11,296 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44163,1689595859880' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-17 12:11:11,299 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,300 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:11,300 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:11,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:11,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:11,300 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:11:11,300 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,300 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:11,300 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:11,300 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,300 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:11:11,301 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,301 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:11:11,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:11,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 12:11:11,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:11,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:11,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:11,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:11,303 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37767,1689595859826' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-17 12:11:11,303 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ff4143e[Count = 1] remaining members to acquire global barrier 2023-07-17 12:11:11,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:11,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:11,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:11,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:11,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:11,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 12:11:11,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:11,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:11,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:11,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:11,311 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44163,1689595859880' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-17 12:11:11,311 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ff4143e[Count = 0] remaining members to acquire global barrier 2023-07-17 12:11:11,311 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-17 12:11:11,311 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,319 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,319 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,319 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-17 12:11:11,319 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-17 12:11:11,319 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-17 12:11:11,319 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:11,319 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34107,1689595859757' in zk 2023-07-17 12:11:11,319 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:11:11,320 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:11:11,320 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689595869273.e519d10bc3f6ef9d04a098ffce068501. 2023-07-17 12:11:11,320 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689595869273.e519d10bc3f6ef9d04a098ffce068501. started... 2023-07-17 12:11:11,320 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:11,320 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 12:11:11,320 INFO [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e519d10bc3f6ef9d04a098ffce068501 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-07-17 12:11:11,322 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,323 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-17 12:11:11,330 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-17 12:11:11,331 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:11:11,331 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-17 12:11:11,331 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:11:11,349 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:11:11,348 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689595869273.5b710b6235e67d124d6af94fba90c29e. 2023-07-17 12:11:11,348 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:11:11,349 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689595869273.5b710b6235e67d124d6af94fba90c29e. started... 2023-07-17 12:11:11,350 INFO [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5b710b6235e67d124d6af94fba90c29e 1/1 column families, dataSize=65 B heapSize=400 B 2023-07-17 12:11:11,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-17 12:11:11,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:11:11,351 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 12:11:11,446 INFO [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportWithTargetName/e519d10bc3f6ef9d04a098ffce068501/.tmp/cf/696f5230970c453da59ceebcab68b015 2023-07-17 12:11:11,447 INFO [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=65 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportWithTargetName/5b710b6235e67d124d6af94fba90c29e/.tmp/cf/4c2c2f2cacf54652855541756dc3a2f2 2023-07-17 12:11:11,500 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportWithTargetName/e519d10bc3f6ef9d04a098ffce068501/.tmp/cf/696f5230970c453da59ceebcab68b015 as hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportWithTargetName/e519d10bc3f6ef9d04a098ffce068501/cf/696f5230970c453da59ceebcab68b015 2023-07-17 12:11:11,500 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportWithTargetName/5b710b6235e67d124d6af94fba90c29e/.tmp/cf/4c2c2f2cacf54652855541756dc3a2f2 as hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportWithTargetName/5b710b6235e67d124d6af94fba90c29e/cf/4c2c2f2cacf54652855541756dc3a2f2 2023-07-17 12:11:11,510 INFO [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportWithTargetName/e519d10bc3f6ef9d04a098ffce068501/cf/696f5230970c453da59ceebcab68b015, entries=49, sequenceid=6, filesize=8.1 K 2023-07-17 12:11:11,515 INFO [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for e519d10bc3f6ef9d04a098ffce068501 in 195ms, sequenceid=6, compaction requested=false 2023-07-17 12:11:11,515 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-17 12:11:11,516 INFO [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportWithTargetName/5b710b6235e67d124d6af94fba90c29e/cf/4c2c2f2cacf54652855541756dc3a2f2, entries=1, sequenceid=6, filesize=4.9 K 2023-07-17 12:11:11,519 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e519d10bc3f6ef9d04a098ffce068501: 2023-07-17 12:11:11,520 INFO [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for 5b710b6235e67d124d6af94fba90c29e in 170ms, sequenceid=6, compaction requested=false 2023-07-17 12:11:11,520 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689595869273.e519d10bc3f6ef9d04a098ffce068501.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-17 12:11:11,521 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5b710b6235e67d124d6af94fba90c29e: 2023-07-17 12:11:11,521 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:11:11,521 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportWithTargetName/e519d10bc3f6ef9d04a098ffce068501/cf/696f5230970c453da59ceebcab68b015] hfiles 2023-07-17 12:11:11,521 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689595869273.5b710b6235e67d124d6af94fba90c29e.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-17 12:11:11,521 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportWithTargetName/e519d10bc3f6ef9d04a098ffce068501/cf/696f5230970c453da59ceebcab68b015 for snapshot=snaptb0-testExportWithTargetName 2023-07-17 12:11:11,521 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:11:11,521 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportWithTargetName/5b710b6235e67d124d6af94fba90c29e/cf/4c2c2f2cacf54652855541756dc3a2f2] hfiles 2023-07-17 12:11:11,521 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportWithTargetName/5b710b6235e67d124d6af94fba90c29e/cf/4c2c2f2cacf54652855541756dc3a2f2 for snapshot=snaptb0-testExportWithTargetName 2023-07-17 12:11:11,552 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:11:11,554 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689595869273.e519d10bc3f6ef9d04a098ffce068501. completed. 2023-07-17 12:11:11,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-17 12:11:11,555 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689595869273.e519d10bc3f6ef9d04a098ffce068501. 2023-07-17 12:11:11,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:11:11,555 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:11:11,555 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:11:11,555 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:11,555 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-17 12:11:11,555 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37767,1689595859826' in zk 2023-07-17 12:11:11,555 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 12:11:11,555 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689595869273.5b710b6235e67d124d6af94fba90c29e. completed. 2023-07-17 12:11:11,555 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689595869273.5b710b6235e67d124d6af94fba90c29e. 2023-07-17 12:11:11,556 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:11:11,556 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:11:11,556 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:11,556 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-17 12:11:11,556 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44163,1689595859880' in zk 2023-07-17 12:11:11,557 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:11,557 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-17 12:11:11,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:11,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:11,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:11,557 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:11:11,558 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-17 12:11:11,559 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:11,559 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-17 12:11:11,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:11,559 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:11:11,559 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-17 12:11:11,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:11,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 12:11:11,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:11,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:11,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:11,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:11,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 12:11:11,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:11,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:11,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:11,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,37767,1689595859826': 2023-07-17 12:11:11,564 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37767,1689595859826' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-17 12:11:11,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:11,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:11,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:11,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:11,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:11,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 12:11:11,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:11,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:11,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:11,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:11,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 12:11:11,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:11,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:11,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:11,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,44163,1689595859880': 2023-07-17 12:11:11,569 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44163,1689595859880' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-17 12:11:11,569 INFO [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-17 12:11:11,569 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 12:11:11,569 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 12:11:11,569 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-17 12:11:11,569 INFO [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 12:11:11,571 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,571 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,571 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:11,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:11,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,571 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:11,571 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:11,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:11,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:11,572 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,572 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:11,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:11,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:11,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:11,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:11,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:11,575 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:11,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 12:11:11,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,576 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:11,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:11,576 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:11,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 12:11:11,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:11,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:11,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:11,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:11,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 12:11:11,578 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:11,579 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:11,579 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:11,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:11,592 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:11,592 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:11,593 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:11,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:11,593 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:11,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:11,593 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:11,592 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:11,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:11,593 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-17 12:11:11,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:11,593 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-17 12:11:11,593 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:11:11,593 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:11,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:11,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:11,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:11,593 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:11,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:11,595 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:11,596 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:11,596 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,596 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:11,596 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:11,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:11,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:11,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:11,596 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:11,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:11,596 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:11,596 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,596 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,597 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,599 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName because node does not exist (not an error) 2023-07-17 12:11:11,635 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,684 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-17 12:11:11,684 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,684 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-17 12:11:11,685 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689595871245Consolidate snapshot: snaptb0-testExportWithTargetName at 1689595871593 (+348 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1689595871593Writing data manifest for snaptb0-testExportWithTargetName at 1689595871602 (+9 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689595871624 (+22 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689595871684 (+60 ms) 2023-07-17 12:11:11,688 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-17 12:11:11,691 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 442 msec 2023-07-17 12:11:11,855 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:11:11,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-17 12:11:11,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 12:11:11,860 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595871860 2023-07-17 12:11:11,860 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40781, tgtDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595871860, rawTgtDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595871860, srcFsUri=hdfs://localhost:40781, srcDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c 2023-07-17 12:11:11,920 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40781, inputRoot=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c 2023-07-17 12:11:11,920 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-294480748_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595871860, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595871860/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-17 12:11:11,921 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40781, inputRoot=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c, snapshotDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-17 12:11:11,941 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595871860/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-17 12:11:12,105 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:12,105 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:12,106 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:12,107 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:12,107 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:12,108 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:12,108 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:12,222 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/hadoop-8297702285771714084.jar 2023-07-17 12:11:12,223 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:12,223 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:12,224 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:12,225 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:12,225 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:12,226 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:12,226 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-17 12:11:12,227 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-17 12:11:12,228 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-17 12:11:12,229 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-17 12:11:12,229 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-17 12:11:12,230 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-17 12:11:12,230 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-17 12:11:12,231 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-17 12:11:12,232 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-17 12:11:12,232 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-17 12:11:12,237 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:11:12,237 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:11:12,238 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 12:11:12,238 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:11:12,238 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:11:12,239 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 12:11:12,240 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 12:11:13,270 WARN [Listener at jenkins-hbase4.apache.org/42275] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-17 12:11:13,276 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-17 12:11:13,285 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-17 12:11:13,844 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 12:11:13,846 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 12:11:14,066 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867780_0001_000001 (auth:SIMPLE) 2023-07-17 12:11:15,309 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 12:11:19,485 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867780_0001_000001 (auth:SIMPLE) 2023-07-17 12:11:21,743 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867780_0001_000001 (auth:SIMPLE) 2023-07-17 12:11:24,761 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867780_0001_000001 (auth:SIMPLE) 2023-07-17 12:11:26,274 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-17 12:11:26,277 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-17 12:11:26,286 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-17 12:11:26,286 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-17 12:11:26,287 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-17 12:11:26,287 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-269744684_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-17 12:11:26,287 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(367): hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-17 12:11:26,288 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(367): hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-17 12:11:26,288 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-269744684_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595871860/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595871860/.hbase-snapshot/testExportWithTargetName 2023-07-17 12:11:26,288 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(367): hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595871860/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-17 12:11:26,288 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(367): hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595871860/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-17 12:11:26,299 INFO [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-17 12:11:26,303 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-17 12:11:26,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-17 12:11:26,316 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595886316"}]},"ts":"1689595886316"} 2023-07-17 12:11:26,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-17 12:11:26,318 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-17 12:11:26,383 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-17 12:11:26,385 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5b710b6235e67d124d6af94fba90c29e, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e519d10bc3f6ef9d04a098ffce068501, UNASSIGN}] 2023-07-17 12:11:26,388 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5b710b6235e67d124d6af94fba90c29e, UNASSIGN 2023-07-17 12:11:26,388 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e519d10bc3f6ef9d04a098ffce068501, UNASSIGN 2023-07-17 12:11:26,389 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=5b710b6235e67d124d6af94fba90c29e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:26,389 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=e519d10bc3f6ef9d04a098ffce068501, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:26,389 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689595869273.5b710b6235e67d124d6af94fba90c29e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689595886389"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595886389"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595886389"}]},"ts":"1689595886389"} 2023-07-17 12:11:26,389 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689595869273.e519d10bc3f6ef9d04a098ffce068501.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689595886389"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595886389"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595886389"}]},"ts":"1689595886389"} 2023-07-17 12:11:26,391 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 5b710b6235e67d124d6af94fba90c29e, server=jenkins-hbase4.apache.org,44163,1689595859880}] 2023-07-17 12:11:26,392 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure e519d10bc3f6ef9d04a098ffce068501, server=jenkins-hbase4.apache.org,37767,1689595859826}] 2023-07-17 12:11:26,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-17 12:11:26,552 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e519d10bc3f6ef9d04a098ffce068501 2023-07-17 12:11:26,552 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5b710b6235e67d124d6af94fba90c29e 2023-07-17 12:11:26,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e519d10bc3f6ef9d04a098ffce068501, disabling compactions & flushes 2023-07-17 12:11:26,553 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5b710b6235e67d124d6af94fba90c29e, disabling compactions & flushes 2023-07-17 12:11:26,553 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689595869273.e519d10bc3f6ef9d04a098ffce068501. 2023-07-17 12:11:26,553 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689595869273.5b710b6235e67d124d6af94fba90c29e. 2023-07-17 12:11:26,553 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689595869273.e519d10bc3f6ef9d04a098ffce068501. 2023-07-17 12:11:26,553 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689595869273.5b710b6235e67d124d6af94fba90c29e. 2023-07-17 12:11:26,553 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689595869273.e519d10bc3f6ef9d04a098ffce068501. after waiting 0 ms 2023-07-17 12:11:26,553 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689595869273.e519d10bc3f6ef9d04a098ffce068501. 2023-07-17 12:11:26,553 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689595869273.5b710b6235e67d124d6af94fba90c29e. after waiting 0 ms 2023-07-17 12:11:26,553 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689595869273.5b710b6235e67d124d6af94fba90c29e. 2023-07-17 12:11:26,567 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportWithTargetName/5b710b6235e67d124d6af94fba90c29e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 12:11:26,567 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportWithTargetName/e519d10bc3f6ef9d04a098ffce068501/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 12:11:26,568 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:11:26,568 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:11:26,570 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689595869273.e519d10bc3f6ef9d04a098ffce068501. 2023-07-17 12:11:26,570 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689595869273.5b710b6235e67d124d6af94fba90c29e. 2023-07-17 12:11:26,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e519d10bc3f6ef9d04a098ffce068501: 2023-07-17 12:11:26,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5b710b6235e67d124d6af94fba90c29e: 2023-07-17 12:11:26,572 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e519d10bc3f6ef9d04a098ffce068501 2023-07-17 12:11:26,573 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=e519d10bc3f6ef9d04a098ffce068501, regionState=CLOSED 2023-07-17 12:11:26,573 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5b710b6235e67d124d6af94fba90c29e 2023-07-17 12:11:26,573 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689595869273.e519d10bc3f6ef9d04a098ffce068501.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689595886573"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595886573"}]},"ts":"1689595886573"} 2023-07-17 12:11:26,574 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=5b710b6235e67d124d6af94fba90c29e, regionState=CLOSED 2023-07-17 12:11:26,574 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689595869273.5b710b6235e67d124d6af94fba90c29e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689595886574"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595886574"}]},"ts":"1689595886574"} 2023-07-17 12:11:26,579 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-17 12:11:26,579 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure e519d10bc3f6ef9d04a098ffce068501, server=jenkins-hbase4.apache.org,37767,1689595859826 in 184 msec 2023-07-17 12:11:26,579 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-17 12:11:26,580 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 5b710b6235e67d124d6af94fba90c29e, server=jenkins-hbase4.apache.org,44163,1689595859880 in 186 msec 2023-07-17 12:11:26,580 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e519d10bc3f6ef9d04a098ffce068501, UNASSIGN in 194 msec 2023-07-17 12:11:26,584 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-17 12:11:26,584 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5b710b6235e67d124d6af94fba90c29e, UNASSIGN in 194 msec 2023-07-17 12:11:26,585 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595886585"}]},"ts":"1689595886585"} 2023-07-17 12:11:26,586 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-17 12:11:26,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-17 12:11:26,683 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-17 12:11:26,686 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 378 msec 2023-07-17 12:11:26,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-17 12:11:26,921 INFO [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-17 12:11:26,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-17 12:11:26,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-17 12:11:26,936 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-17 12:11:26,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-17 12:11:26,939 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-17 12:11:26,942 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44163] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-17 12:11:26,945 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportWithTargetName/5b710b6235e67d124d6af94fba90c29e 2023-07-17 12:11:26,945 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportWithTargetName/e519d10bc3f6ef9d04a098ffce068501 2023-07-17 12:11:26,949 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportWithTargetName/e519d10bc3f6ef9d04a098ffce068501/cf, FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportWithTargetName/e519d10bc3f6ef9d04a098ffce068501/recovered.edits] 2023-07-17 12:11:26,949 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportWithTargetName/5b710b6235e67d124d6af94fba90c29e/cf, FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportWithTargetName/5b710b6235e67d124d6af94fba90c29e/recovered.edits] 2023-07-17 12:11:26,956 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportWithTargetName/e519d10bc3f6ef9d04a098ffce068501/cf/696f5230970c453da59ceebcab68b015 to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/archive/data/default/testtb-testExportWithTargetName/e519d10bc3f6ef9d04a098ffce068501/cf/696f5230970c453da59ceebcab68b015 2023-07-17 12:11:26,956 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportWithTargetName/5b710b6235e67d124d6af94fba90c29e/cf/4c2c2f2cacf54652855541756dc3a2f2 to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/archive/data/default/testtb-testExportWithTargetName/5b710b6235e67d124d6af94fba90c29e/cf/4c2c2f2cacf54652855541756dc3a2f2 2023-07-17 12:11:26,960 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportWithTargetName/e519d10bc3f6ef9d04a098ffce068501/recovered.edits/9.seqid to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/archive/data/default/testtb-testExportWithTargetName/e519d10bc3f6ef9d04a098ffce068501/recovered.edits/9.seqid 2023-07-17 12:11:26,961 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportWithTargetName/5b710b6235e67d124d6af94fba90c29e/recovered.edits/9.seqid to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/archive/data/default/testtb-testExportWithTargetName/5b710b6235e67d124d6af94fba90c29e/recovered.edits/9.seqid 2023-07-17 12:11:26,961 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportWithTargetName/e519d10bc3f6ef9d04a098ffce068501 2023-07-17 12:11:26,962 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportWithTargetName/5b710b6235e67d124d6af94fba90c29e 2023-07-17 12:11:26,962 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-17 12:11:26,964 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-17 12:11:26,985 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-17 12:11:26,988 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-17 12:11:26,989 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-17 12:11:26,989 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-17 12:11:26,990 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689595869273.5b710b6235e67d124d6af94fba90c29e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689595886990"}]},"ts":"9223372036854775807"} 2023-07-17 12:11:26,990 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689595869273.e519d10bc3f6ef9d04a098ffce068501.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689595886990"}]},"ts":"9223372036854775807"} 2023-07-17 12:11:26,992 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-17 12:11:26,992 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5b710b6235e67d124d6af94fba90c29e, NAME => 'testtb-testExportWithTargetName,,1689595869273.5b710b6235e67d124d6af94fba90c29e.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e519d10bc3f6ef9d04a098ffce068501, NAME => 'testtb-testExportWithTargetName,1,1689595869273.e519d10bc3f6ef9d04a098ffce068501.', STARTKEY => '1', ENDKEY => ''}] 2023-07-17 12:11:26,992 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-17 12:11:26,992 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689595886992"}]},"ts":"9223372036854775807"} 2023-07-17 12:11:26,994 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-17 12:11:27,115 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-17 12:11:27,119 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 187 msec 2023-07-17 12:11:27,198 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-17 12:11:27,198 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-17 12:11:27,198 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-17 12:11:27,198 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-17 12:11:27,199 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-17 12:11:27,199 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-17 12:11:27,199 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-17 12:11:27,199 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-17 12:11:27,298 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-17 12:11:27,298 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-17 12:11:27,298 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:11:27,298 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:11:27,298 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-17 12:11:27,298 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-17 12:11:27,299 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:11:27,299 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:11:27,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-17 12:11:27,302 INFO [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-17 12:11:27,319 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-17 12:11:27,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-17 12:11:27,324 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-17 12:11:27,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-17 12:11:27,357 INFO [Listener at jenkins-hbase4.apache.org/42275] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=756 (was 710) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/cluster_9a1a9b04-7c81-e777-0050-74120a585f3f/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (905985230) connection to jenkins-hbase4.apache.org/172.31.14.131:43003 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1280 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x24b8e848-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1005523934_1 at /127.0.0.1:59072 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-269744684_17 at /127.0.0.1:56852 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-269744684_17 at /127.0.0.1:59088 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/cluster_9a1a9b04-7c81-e777-0050-74120a585f3f/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x24b8e848-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x24b8e848-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/cluster_9a1a9b04-7c81-e777-0050-74120a585f3f/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/cluster_9a1a9b04-7c81-e777-0050-74120a585f3f/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-269744684_17 at /127.0.0.1:50680 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1005523934_1 at /127.0.0.1:50666 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x24b8e848-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (905985230) connection to jenkins-hbase4.apache.org/172.31.14.131:34963 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/cluster_9a1a9b04-7c81-e777-0050-74120a585f3f/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/cluster_9a1a9b04-7c81-e777-0050-74120a585f3f/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=924 (was 900) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=524 (was 403) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 174) - ProcessCount LEAK? -, AvailableMemoryMB=3153 (was 4915) 2023-07-17 12:11:27,357 WARN [Listener at jenkins-hbase4.apache.org/42275] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-07-17 12:11:27,377 INFO [Listener at jenkins-hbase4.apache.org/42275] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=756, OpenFileDescriptor=924, MaxFileDescriptor=60000, SystemLoadAverage=524, ProcessCount=180, AvailableMemoryMB=3153 2023-07-17 12:11:27,377 WARN [Listener at jenkins-hbase4.apache.org/42275] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-07-17 12:11:27,379 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-17 12:11:27,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-17 12:11:27,385 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 12:11:27,385 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-17 12:11:27,386 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 12:11:27,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-17 12:11:27,389 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemState/884e404dccbd089125d3e5d53f1680be 2023-07-17 12:11:27,389 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemState/6d85eef6cb250a32f438704e73bbf5ce 2023-07-17 12:11:27,390 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemState/884e404dccbd089125d3e5d53f1680be empty. 2023-07-17 12:11:27,390 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemState/6d85eef6cb250a32f438704e73bbf5ce empty. 2023-07-17 12:11:27,390 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemState/884e404dccbd089125d3e5d53f1680be 2023-07-17 12:11:27,390 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemState/6d85eef6cb250a32f438704e73bbf5ce 2023-07-17 12:11:27,390 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-17 12:11:27,415 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-17 12:11:27,417 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 884e404dccbd089125d3e5d53f1680be, NAME => 'testtb-testExportFileSystemState,,1689595887379.884e404dccbd089125d3e5d53f1680be.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp 2023-07-17 12:11:27,417 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6d85eef6cb250a32f438704e73bbf5ce, NAME => 'testtb-testExportFileSystemState,1,1689595887379.6d85eef6cb250a32f438704e73bbf5ce.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp 2023-07-17 12:11:27,450 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689595887379.6d85eef6cb250a32f438704e73bbf5ce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:11:27,450 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 6d85eef6cb250a32f438704e73bbf5ce, disabling compactions & flushes 2023-07-17 12:11:27,450 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689595887379.884e404dccbd089125d3e5d53f1680be.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:11:27,451 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689595887379.6d85eef6cb250a32f438704e73bbf5ce. 2023-07-17 12:11:27,451 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 884e404dccbd089125d3e5d53f1680be, disabling compactions & flushes 2023-07-17 12:11:27,451 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689595887379.6d85eef6cb250a32f438704e73bbf5ce. 2023-07-17 12:11:27,451 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689595887379.884e404dccbd089125d3e5d53f1680be. 2023-07-17 12:11:27,451 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689595887379.6d85eef6cb250a32f438704e73bbf5ce. after waiting 0 ms 2023-07-17 12:11:27,451 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689595887379.884e404dccbd089125d3e5d53f1680be. 2023-07-17 12:11:27,451 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689595887379.6d85eef6cb250a32f438704e73bbf5ce. 2023-07-17 12:11:27,451 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689595887379.884e404dccbd089125d3e5d53f1680be. after waiting 0 ms 2023-07-17 12:11:27,451 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689595887379.884e404dccbd089125d3e5d53f1680be. 2023-07-17 12:11:27,451 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689595887379.6d85eef6cb250a32f438704e73bbf5ce. 2023-07-17 12:11:27,451 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689595887379.884e404dccbd089125d3e5d53f1680be. 2023-07-17 12:11:27,451 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 884e404dccbd089125d3e5d53f1680be: 2023-07-17 12:11:27,451 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 6d85eef6cb250a32f438704e73bbf5ce: 2023-07-17 12:11:27,454 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 12:11:27,456 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689595887379.884e404dccbd089125d3e5d53f1680be.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689595887455"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595887455"}]},"ts":"1689595887455"} 2023-07-17 12:11:27,456 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689595887379.6d85eef6cb250a32f438704e73bbf5ce.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689595887455"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595887455"}]},"ts":"1689595887455"} 2023-07-17 12:11:27,458 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-17 12:11:27,459 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 12:11:27,459 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595887459"}]},"ts":"1689595887459"} 2023-07-17 12:11:27,461 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-17 12:11:27,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-17 12:11:27,583 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 12:11:27,585 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 12:11:27,585 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 12:11:27,585 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 12:11:27,585 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 12:11:27,585 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=884e404dccbd089125d3e5d53f1680be, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6d85eef6cb250a32f438704e73bbf5ce, ASSIGN}] 2023-07-17 12:11:27,588 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=884e404dccbd089125d3e5d53f1680be, ASSIGN 2023-07-17 12:11:27,588 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6d85eef6cb250a32f438704e73bbf5ce, ASSIGN 2023-07-17 12:11:27,589 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6d85eef6cb250a32f438704e73bbf5ce, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37767,1689595859826; forceNewPlan=false, retain=false 2023-07-17 12:11:27,589 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=884e404dccbd089125d3e5d53f1680be, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34107,1689595859757; forceNewPlan=false, retain=false 2023-07-17 12:11:27,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-17 12:11:27,740 INFO [jenkins-hbase4:35573] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-17 12:11:27,742 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=6d85eef6cb250a32f438704e73bbf5ce, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:27,742 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=884e404dccbd089125d3e5d53f1680be, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:27,743 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689595887379.6d85eef6cb250a32f438704e73bbf5ce.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689595887742"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595887742"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595887742"}]},"ts":"1689595887742"} 2023-07-17 12:11:27,743 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689595887379.884e404dccbd089125d3e5d53f1680be.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689595887742"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595887742"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595887742"}]},"ts":"1689595887742"} 2023-07-17 12:11:27,745 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 6d85eef6cb250a32f438704e73bbf5ce, server=jenkins-hbase4.apache.org,37767,1689595859826}] 2023-07-17 12:11:27,746 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 884e404dccbd089125d3e5d53f1680be, server=jenkins-hbase4.apache.org,34107,1689595859757}] 2023-07-17 12:11:27,906 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689595887379.6d85eef6cb250a32f438704e73bbf5ce. 2023-07-17 12:11:27,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6d85eef6cb250a32f438704e73bbf5ce, NAME => 'testtb-testExportFileSystemState,1,1689595887379.6d85eef6cb250a32f438704e73bbf5ce.', STARTKEY => '1', ENDKEY => ''} 2023-07-17 12:11:27,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689595887379.6d85eef6cb250a32f438704e73bbf5ce. service=AccessControlService 2023-07-17 12:11:27,907 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 12:11:27,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 6d85eef6cb250a32f438704e73bbf5ce 2023-07-17 12:11:27,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689595887379.6d85eef6cb250a32f438704e73bbf5ce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:11:27,907 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689595887379.884e404dccbd089125d3e5d53f1680be. 2023-07-17 12:11:27,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6d85eef6cb250a32f438704e73bbf5ce 2023-07-17 12:11:27,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6d85eef6cb250a32f438704e73bbf5ce 2023-07-17 12:11:27,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 884e404dccbd089125d3e5d53f1680be, NAME => 'testtb-testExportFileSystemState,,1689595887379.884e404dccbd089125d3e5d53f1680be.', STARTKEY => '', ENDKEY => '1'} 2023-07-17 12:11:27,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689595887379.884e404dccbd089125d3e5d53f1680be. service=AccessControlService 2023-07-17 12:11:27,908 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 12:11:27,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 884e404dccbd089125d3e5d53f1680be 2023-07-17 12:11:27,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689595887379.884e404dccbd089125d3e5d53f1680be.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:11:27,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 884e404dccbd089125d3e5d53f1680be 2023-07-17 12:11:27,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 884e404dccbd089125d3e5d53f1680be 2023-07-17 12:11:27,909 INFO [StoreOpener-6d85eef6cb250a32f438704e73bbf5ce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6d85eef6cb250a32f438704e73bbf5ce 2023-07-17 12:11:27,910 INFO [StoreOpener-884e404dccbd089125d3e5d53f1680be-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 884e404dccbd089125d3e5d53f1680be 2023-07-17 12:11:27,910 DEBUG [StoreOpener-6d85eef6cb250a32f438704e73bbf5ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemState/6d85eef6cb250a32f438704e73bbf5ce/cf 2023-07-17 12:11:27,910 DEBUG [StoreOpener-6d85eef6cb250a32f438704e73bbf5ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemState/6d85eef6cb250a32f438704e73bbf5ce/cf 2023-07-17 12:11:27,911 INFO [StoreOpener-6d85eef6cb250a32f438704e73bbf5ce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6d85eef6cb250a32f438704e73bbf5ce columnFamilyName cf 2023-07-17 12:11:27,911 DEBUG [StoreOpener-884e404dccbd089125d3e5d53f1680be-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemState/884e404dccbd089125d3e5d53f1680be/cf 2023-07-17 12:11:27,911 DEBUG [StoreOpener-884e404dccbd089125d3e5d53f1680be-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemState/884e404dccbd089125d3e5d53f1680be/cf 2023-07-17 12:11:27,911 INFO [StoreOpener-6d85eef6cb250a32f438704e73bbf5ce-1] regionserver.HStore(310): Store=6d85eef6cb250a32f438704e73bbf5ce/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 12:11:27,913 INFO [StoreOpener-884e404dccbd089125d3e5d53f1680be-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 884e404dccbd089125d3e5d53f1680be columnFamilyName cf 2023-07-17 12:11:27,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemState/6d85eef6cb250a32f438704e73bbf5ce 2023-07-17 12:11:27,913 INFO [StoreOpener-884e404dccbd089125d3e5d53f1680be-1] regionserver.HStore(310): Store=884e404dccbd089125d3e5d53f1680be/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 12:11:27,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemState/6d85eef6cb250a32f438704e73bbf5ce 2023-07-17 12:11:27,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemState/884e404dccbd089125d3e5d53f1680be 2023-07-17 12:11:27,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemState/884e404dccbd089125d3e5d53f1680be 2023-07-17 12:11:27,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6d85eef6cb250a32f438704e73bbf5ce 2023-07-17 12:11:27,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 884e404dccbd089125d3e5d53f1680be 2023-07-17 12:11:27,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemState/6d85eef6cb250a32f438704e73bbf5ce/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 12:11:27,920 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6d85eef6cb250a32f438704e73bbf5ce; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65128467, jitterRate=-0.029510214924812317}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 12:11:27,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6d85eef6cb250a32f438704e73bbf5ce: 2023-07-17 12:11:27,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemState/884e404dccbd089125d3e5d53f1680be/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 12:11:27,921 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689595887379.6d85eef6cb250a32f438704e73bbf5ce., pid=30, masterSystemTime=1689595887898 2023-07-17 12:11:27,922 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 884e404dccbd089125d3e5d53f1680be; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75100431, jitterRate=0.11908362805843353}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 12:11:27,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 884e404dccbd089125d3e5d53f1680be: 2023-07-17 12:11:27,923 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689595887379.884e404dccbd089125d3e5d53f1680be., pid=31, masterSystemTime=1689595887899 2023-07-17 12:11:27,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689595887379.6d85eef6cb250a32f438704e73bbf5ce. 2023-07-17 12:11:27,924 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689595887379.6d85eef6cb250a32f438704e73bbf5ce. 2023-07-17 12:11:27,925 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=6d85eef6cb250a32f438704e73bbf5ce, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:27,925 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689595887379.6d85eef6cb250a32f438704e73bbf5ce.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689595887924"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689595887924"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689595887924"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689595887924"}]},"ts":"1689595887924"} 2023-07-17 12:11:27,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689595887379.884e404dccbd089125d3e5d53f1680be. 2023-07-17 12:11:27,926 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689595887379.884e404dccbd089125d3e5d53f1680be. 2023-07-17 12:11:27,926 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=884e404dccbd089125d3e5d53f1680be, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:27,928 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689595887379.884e404dccbd089125d3e5d53f1680be.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689595887926"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689595887926"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689595887926"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689595887926"}]},"ts":"1689595887926"} 2023-07-17 12:11:27,931 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-17 12:11:27,931 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 6d85eef6cb250a32f438704e73bbf5ce, server=jenkins-hbase4.apache.org,37767,1689595859826 in 183 msec 2023-07-17 12:11:27,933 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-17 12:11:27,933 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6d85eef6cb250a32f438704e73bbf5ce, ASSIGN in 346 msec 2023-07-17 12:11:27,934 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 884e404dccbd089125d3e5d53f1680be, server=jenkins-hbase4.apache.org,34107,1689595859757 in 184 msec 2023-07-17 12:11:27,936 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-17 12:11:27,936 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=884e404dccbd089125d3e5d53f1680be, ASSIGN in 348 msec 2023-07-17 12:11:27,937 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 12:11:27,938 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595887937"}]},"ts":"1689595887937"} 2023-07-17 12:11:27,939 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-17 12:11:27,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-17 12:11:28,023 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 12:11:28,023 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-17 12:11:28,026 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44163] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-17 12:11:28,076 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:11:28,076 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:11:28,076 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:11:28,076 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:11:28,137 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 12:11:28,137 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 12:11:28,137 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 12:11:28,137 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 12:11:28,140 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 756 msec 2023-07-17 12:11:28,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-17 12:11:28,492 INFO [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-17 12:11:28,492 DEBUG [Listener at jenkins-hbase4.apache.org/42275] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-17 12:11:28,493 INFO [Listener at jenkins-hbase4.apache.org/42275] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 12:11:28,497 INFO [Listener at jenkins-hbase4.apache.org/42275] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-17 12:11:28,497 INFO [Listener at jenkins-hbase4.apache.org/42275] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 12:11:28,497 INFO [Listener at jenkins-hbase4.apache.org/42275] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-17 12:11:28,504 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 12:11:28,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689595888504 (current time:1689595888504). 2023-07-17 12:11:28,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 12:11:28,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(139): Connect 0x2ca78336 to 127.0.0.1:60075 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:11:28,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2940a2af, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:11:28,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:11:28,548 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34854, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:11:28,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2ca78336 to 127.0.0.1:60075 2023-07-17 12:11:28,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:11:28,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(139): Connect 0x19072bb1 to 127.0.0.1:60075 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:11:28,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@9a9a594, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:11:28,638 DEBUG [hconnection-0x25502bd4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:11:28,643 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34864, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:11:28,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:11:28,651 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58750, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:11:28,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x19072bb1 to 127.0.0.1:60075 2023-07-17 12:11:28,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:11:28,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-17 12:11:28,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 12:11:28,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 12:11:28,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-17 12:11:28,659 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-17 12:11:28,660 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689596488660 2023-07-17 12:11:28,660 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-17 12:11:28,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 12:11:28,662 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 12:11:28,662 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 12:11:28,662 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-17 12:11:28,663 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-17 12:11:28,671 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 12 msec 2023-07-17 12:11:28,672 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-17 12:11:28,673 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689596488673 2023-07-17 12:11:28,697 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:28,697 INFO [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-17 12:11:28,697 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:11:28,699 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-17 12:11:28,699 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-17 12:11:28,701 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:28,701 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:28,745 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:28,745 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:28,745 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:28,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:28,745 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:28,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:28,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:28,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:28,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:28,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:28,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:28,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:28,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:28,746 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:28,746 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:28,746 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:28,746 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:28,747 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:28,747 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 12:11:28,747 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:28,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-17 12:11:28,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:28,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-17 12:11:28,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:28,747 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-17 12:11:28,747 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-17 12:11:28,748 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:28,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-17 12:11:28,748 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:28,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:28,748 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-17 12:11:28,748 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-17 12:11:28,748 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:11:28,748 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-17 12:11:28,748 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:11:28,750 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-17 12:11:28,756 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-17 12:11:28,756 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44163,1689595859880' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-17 12:11:28,756 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-17 12:11:28,756 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-17 12:11:28,756 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37767,1689595859826' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-17 12:11:28,756 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:28,756 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-17 12:11:28,756 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:11:28,758 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-17 12:11:28,758 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-17 12:11:28,758 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34107,1689595859757' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-17 12:11:28,762 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:11:28,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 12:11:28,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:11:28,764 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 12:11:28,814 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:28,814 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:28,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:28,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:28,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:28,964 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:11:28,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 12:11:28,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:11:28,965 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 12:11:29,075 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:29,075 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,076 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:11:29,075 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:29,075 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,076 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,076 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:11:29,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:29,076 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,076 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:11:29,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:29,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:29,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:29,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:29,078 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37767,1689595859826' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-17 12:11:29,078 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9807799[Count = 1] remaining members to acquire global barrier 2023-07-17 12:11:29,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:29,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:29,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:29,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:29,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:29,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:29,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:29,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:29,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:29,080 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34107,1689595859757' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-17 12:11:29,080 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9807799[Count = 0] remaining members to acquire global barrier 2023-07-17 12:11:29,080 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-17 12:11:29,080 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,129 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,129 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,129 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,129 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-17 12:11:29,130 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-17 12:11:29,130 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44163,1689595859880' in zk 2023-07-17 12:11:29,129 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:29,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,130 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-17 12:11:29,130 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-17 12:11:29,130 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:11:29,130 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:11:29,130 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:11:29,130 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689595887379.6d85eef6cb250a32f438704e73bbf5ce. 2023-07-17 12:11:29,130 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:29,130 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 12:11:29,130 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689595887379.6d85eef6cb250a32f438704e73bbf5ce. started... 2023-07-17 12:11:29,130 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689595887379.884e404dccbd089125d3e5d53f1680be. 2023-07-17 12:11:29,130 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:11:29,130 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689595887379.884e404dccbd089125d3e5d53f1680be. started... 2023-07-17 12:11:29,132 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6d85eef6cb250a32f438704e73bbf5ce: 2023-07-17 12:11:29,133 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 884e404dccbd089125d3e5d53f1680be: 2023-07-17 12:11:29,133 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689595887379.6d85eef6cb250a32f438704e73bbf5ce.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,133 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689595887379.884e404dccbd089125d3e5d53f1680be.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,133 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:11:29,133 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:11:29,133 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 12:11:29,133 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 12:11:29,143 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689595887379.6d85eef6cb250a32f438704e73bbf5ce. completed. 2023-07-17 12:11:29,143 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689595887379.6d85eef6cb250a32f438704e73bbf5ce. 2023-07-17 12:11:29,143 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:11:29,143 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:11:29,143 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:29,143 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-17 12:11:29,143 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689595887379.884e404dccbd089125d3e5d53f1680be. completed. 2023-07-17 12:11:29,143 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689595887379.884e404dccbd089125d3e5d53f1680be. 2023-07-17 12:11:29,143 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37767,1689595859826' in zk 2023-07-17 12:11:29,143 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:11:29,143 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:11:29,143 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:29,143 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-17 12:11:29,143 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34107,1689595859757' in zk 2023-07-17 12:11:29,160 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-17 12:11:29,160 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:11:29,160 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-17 12:11:29,206 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-17 12:11:29,206 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-17 12:11:29,206 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:29,206 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:11:29,206 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:29,206 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:11:29,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:29,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:29,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:29,206 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-17 12:11:29,208 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-17 12:11:29,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:29,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:29,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:29,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:29,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:29,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:29,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:29,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:29,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:29,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,37767,1689595859826': 2023-07-17 12:11:29,213 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37767,1689595859826' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-17 12:11:29,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:29,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:29,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:29,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:29,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:29,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:29,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:29,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:29,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:29,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:29,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:29,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:29,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,34107,1689595859757': 2023-07-17 12:11:29,217 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34107,1689595859757' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-17 12:11:29,217 INFO [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-17 12:11:29,217 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 12:11:29,217 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 12:11:29,217 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,217 INFO [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 12:11:29,245 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,245 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,245 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,245 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,246 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:29,246 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:29,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:29,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:29,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,246 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:29,246 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:29,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:29,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:29,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:29,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:29,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:29,247 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:29,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:29,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:29,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,247 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:29,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:29,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:29,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:29,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:29,250 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:29,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:29,250 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:29,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,250 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:29,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:29,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:29,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:29,265 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:11:29,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 12:11:29,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:11:29,267 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-17 12:11:29,291 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:29,291 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:29,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:29,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:29,291 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:11:29,291 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:29,291 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:29,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:29,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:29,293 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:29,291 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:29,293 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,291 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:29,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:29,291 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:29,293 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:29,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:29,293 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:29,293 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:29,293 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,293 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:29,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:29,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:29,293 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:29,293 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:29,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:29,294 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:29,294 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,294 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,294 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,314 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,336 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-17 12:11:29,336 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,336 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:29,336 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689595888661Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689595889293 (+632 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689595889293Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689595889297 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689595889306 (+9 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689595889336 (+30 ms) 2023-07-17 12:11:29,339 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-17 12:11:29,341 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 678 msec 2023-07-17 12:11:29,767 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:11:29,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 12:11:29,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 12:11:29,779 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34107] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689595887379.884e404dccbd089125d3e5d53f1680be. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 12:11:29,781 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37767] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689595887379.6d85eef6cb250a32f438704e73bbf5ce. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 12:11:29,788 DEBUG [Listener at jenkins-hbase4.apache.org/42275] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-17 12:11:29,789 DEBUG [Listener at jenkins-hbase4.apache.org/42275] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689595887379.884e404dccbd089125d3e5d53f1680be. 2023-07-17 12:11:29,791 INFO [Listener at jenkins-hbase4.apache.org/42275] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 12:11:29,803 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 12:11:29,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689595889803 (current time:1689595889803). 2023-07-17 12:11:29,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 12:11:29,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(139): Connect 0x354789a8 to 127.0.0.1:60075 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:11:29,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73cd8085, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:11:29,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:11:29,814 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34868, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:11:29,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x354789a8 to 127.0.0.1:60075 2023-07-17 12:11:29,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:11:29,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(139): Connect 0x3b953c3c to 127.0.0.1:60075 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:11:29,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d408f40, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:11:29,824 DEBUG [hconnection-0x5445b74f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:11:29,825 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34882, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:11:29,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:11:29,832 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58754, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:11:29,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3b953c3c to 127.0.0.1:60075 2023-07-17 12:11:29,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:11:29,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-17 12:11:29,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 12:11:29,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 12:11:29,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-17 12:11:29,838 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-17 12:11:29,840 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689596489840 2023-07-17 12:11:29,840 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-17 12:11:29,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 12:11:29,840 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 12:11:29,840 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 12:11:29,843 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-17 12:11:29,845 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-17 12:11:29,845 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-17 12:11:29,846 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-17 12:11:29,847 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689596489847 2023-07-17 12:11:29,866 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-17 12:11:29,866 INFO [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-17 12:11:29,866 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:11:29,868 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-17 12:11:29,868 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-17 12:11:29,868 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 12:11:29,868 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 12:11:29,870 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:29,870 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:29,870 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:29,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:29,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:29,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:29,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:29,870 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:29,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 12:11:29,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 12:11:29,871 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:29,871 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:29,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:29,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:29,871 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 12:11:29,871 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 12:11:29,871 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:29,871 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 12:11:29,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 12:11:29,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-17 12:11:29,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 12:11:29,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-17 12:11:29,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 12:11:29,872 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 12:11:29,872 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-17 12:11:29,872 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-17 12:11:29,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-17 12:11:29,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 12:11:29,873 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-17 12:11:29,874 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-17 12:11:29,875 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-17 12:11:29,875 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:11:29,875 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-17 12:11:29,876 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-17 12:11:29,875 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-17 12:11:29,877 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-17 12:11:29,877 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-17 12:11:29,876 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-17 12:11:29,877 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:11:29,877 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34107,1689595859757' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-17 12:11:29,878 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-17 12:11:29,878 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-17 12:11:29,877 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:11:29,878 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37767,1689595859826' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-17 12:11:29,879 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-17 12:11:29,880 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-17 12:11:29,880 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44163,1689595859880' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-17 12:11:29,881 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:29,881 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 12:11:29,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:29,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:29,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:29,882 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 12:11:29,882 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:29,884 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 12:11:29,884 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 12:11:29,884 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:11:29,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:29,884 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 12:11:29,884 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:11:29,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:29,885 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 12:11:29,885 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:11:29,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 12:11:29,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:29,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:29,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:29,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:29,887 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34107,1689595859757' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-17 12:11:29,887 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36eac773[Count = 1] remaining members to acquire global barrier 2023-07-17 12:11:29,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:29,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:29,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:29,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:29,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:29,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 12:11:29,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:29,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:29,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:29,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:29,890 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37767,1689595859826' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-17 12:11:29,890 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36eac773[Count = 0] remaining members to acquire global barrier 2023-07-17 12:11:29,890 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-17 12:11:29,890 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 12:11:29,892 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 12:11:29,892 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 12:11:29,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 12:11:29,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 12:11:29,892 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 12:11:29,892 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-17 12:11:29,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 12:11:29,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 12:11:29,893 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:29,893 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-17 12:11:29,893 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-17 12:11:29,893 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44163,1689595859880' in zk 2023-07-17 12:11:29,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 12:11:29,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 12:11:29,893 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-17 12:11:29,893 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:29,893 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 12:11:29,894 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:11:29,894 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:11:29,894 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:11:29,894 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:11:29,894 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689595887379.6d85eef6cb250a32f438704e73bbf5ce. 2023-07-17 12:11:29,894 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689595887379.884e404dccbd089125d3e5d53f1680be. 2023-07-17 12:11:29,894 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689595887379.6d85eef6cb250a32f438704e73bbf5ce. started... 2023-07-17 12:11:29,894 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689595887379.884e404dccbd089125d3e5d53f1680be. started... 2023-07-17 12:11:29,895 INFO [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 884e404dccbd089125d3e5d53f1680be 1/1 column families, dataSize=534 B heapSize=1.38 KB 2023-07-17 12:11:29,895 INFO [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6d85eef6cb250a32f438704e73bbf5ce 1/1 column families, dataSize=2.74 KB heapSize=6.16 KB 2023-07-17 12:11:29,895 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-17 12:11:29,895 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:11:29,895 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-17 12:11:29,937 INFO [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.74 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemState/6d85eef6cb250a32f438704e73bbf5ce/.tmp/cf/ee043e946e0a410680a1d936d5dfa25f 2023-07-17 12:11:29,940 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:11:29,942 INFO [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=534 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemState/884e404dccbd089125d3e5d53f1680be/.tmp/cf/989ba79d20044b08947f2cfa9a2b76af 2023-07-17 12:11:29,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 12:11:29,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:11:29,943 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 12:11:29,951 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemState/884e404dccbd089125d3e5d53f1680be/.tmp/cf/989ba79d20044b08947f2cfa9a2b76af as hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemState/884e404dccbd089125d3e5d53f1680be/cf/989ba79d20044b08947f2cfa9a2b76af 2023-07-17 12:11:29,953 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemState/6d85eef6cb250a32f438704e73bbf5ce/.tmp/cf/ee043e946e0a410680a1d936d5dfa25f as hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemState/6d85eef6cb250a32f438704e73bbf5ce/cf/ee043e946e0a410680a1d936d5dfa25f 2023-07-17 12:11:29,959 INFO [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemState/884e404dccbd089125d3e5d53f1680be/cf/989ba79d20044b08947f2cfa9a2b76af, entries=8, sequenceid=6, filesize=5.4 K 2023-07-17 12:11:29,963 INFO [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~534 B/534, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 884e404dccbd089125d3e5d53f1680be in 68ms, sequenceid=6, compaction requested=false 2023-07-17 12:11:29,963 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-17 12:11:29,964 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 884e404dccbd089125d3e5d53f1680be: 2023-07-17 12:11:29,964 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689595887379.884e404dccbd089125d3e5d53f1680be.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-17 12:11:29,964 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:11:29,964 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemState/884e404dccbd089125d3e5d53f1680be/cf/989ba79d20044b08947f2cfa9a2b76af] hfiles 2023-07-17 12:11:29,964 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemState/884e404dccbd089125d3e5d53f1680be/cf/989ba79d20044b08947f2cfa9a2b76af for snapshot=snaptb0-testExportFileSystemState 2023-07-17 12:11:29,966 INFO [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemState/6d85eef6cb250a32f438704e73bbf5ce/cf/ee043e946e0a410680a1d936d5dfa25f, entries=42, sequenceid=6, filesize=7.7 K 2023-07-17 12:11:29,969 INFO [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.74 KB/2802, heapSize ~6.14 KB/6288, currentSize=0 B/0 for 6d85eef6cb250a32f438704e73bbf5ce in 75ms, sequenceid=6, compaction requested=false 2023-07-17 12:11:29,971 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6d85eef6cb250a32f438704e73bbf5ce: 2023-07-17 12:11:29,971 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689595887379.6d85eef6cb250a32f438704e73bbf5ce.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-17 12:11:29,971 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:11:29,972 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemState/6d85eef6cb250a32f438704e73bbf5ce/cf/ee043e946e0a410680a1d936d5dfa25f] hfiles 2023-07-17 12:11:29,972 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemState/6d85eef6cb250a32f438704e73bbf5ce/cf/ee043e946e0a410680a1d936d5dfa25f for snapshot=snaptb0-testExportFileSystemState 2023-07-17 12:11:29,999 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689595887379.884e404dccbd089125d3e5d53f1680be. completed. 2023-07-17 12:11:29,999 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689595887379.884e404dccbd089125d3e5d53f1680be. 2023-07-17 12:11:29,999 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:11:29,999 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:11:29,999 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:30,002 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-17 12:11:30,002 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34107,1689595859757' in zk 2023-07-17 12:11:30,006 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689595887379.6d85eef6cb250a32f438704e73bbf5ce. completed. 2023-07-17 12:11:30,007 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689595887379.6d85eef6cb250a32f438704e73bbf5ce. 2023-07-17 12:11:30,007 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:11:30,007 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:11:30,007 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:30,007 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-17 12:11:30,007 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37767,1689595859826' in zk 2023-07-17 12:11:30,007 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:30,007 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-17 12:11:30,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:30,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:30,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:30,007 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:11:30,008 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-17 12:11:30,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:30,012 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:30,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:30,012 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-17 12:11:30,012 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:11:30,012 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-17 12:11:30,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 12:11:30,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:30,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:30,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:30,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:30,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 12:11:30,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:30,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:30,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:30,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,34107,1689595859757': 2023-07-17 12:11:30,023 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34107,1689595859757' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-17 12:11:30,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:30,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:30,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:30,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:30,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:30,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 12:11:30,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:30,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:30,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:30,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:30,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 12:11:30,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:30,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:30,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:30,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,37767,1689595859826': 2023-07-17 12:11:30,031 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37767,1689595859826' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-17 12:11:30,032 INFO [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-17 12:11:30,032 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 12:11:30,032 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 12:11:30,032 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-17 12:11:30,032 INFO [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 12:11:30,034 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,034 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,034 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:30,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,034 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,034 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,035 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:30,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:30,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:30,034 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:30,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:30,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:30,036 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:30,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:30,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:30,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:30,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:30,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:30,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,047 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:30,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 12:11:30,053 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:30,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:30,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 12:11:30,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:30,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:30,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:30,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:30,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 12:11:30,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:30,058 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:30,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:30,058 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:30,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:30,059 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:30,066 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:30,066 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,066 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:30,066 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:30,066 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:30,067 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:30,067 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,067 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:30,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:30,067 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:11:30,067 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:30,069 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:30,067 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-17 12:11:30,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:30,070 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-17 12:11:30,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:30,067 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,071 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:30,071 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:30,071 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,071 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:30,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:30,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:30,070 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:30,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:30,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:30,070 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:30,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:30,071 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:30,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:30,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:30,120 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,143 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:11:30,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 12:11:30,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:11:30,145 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 12:11:30,159 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-17 12:11:30,159 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,160 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,160 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689595889840Consolidate snapshot: snaptb0-testExportFileSystemState at 1689595890070 (+230 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1689595890070Writing data manifest for snaptb0-testExportFileSystemState at 1689595890078 (+8 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689595890106 (+28 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689595890159 (+53 ms) 2023-07-17 12:11:30,163 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-17 12:11:30,165 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 320 msec 2023-07-17 12:11:30,445 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:11:30,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 12:11:30,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 12:11:30,452 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595890452 2023-07-17 12:11:30,452 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40781, tgtDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595890452, rawTgtDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595890452, srcFsUri=hdfs://localhost:40781, srcDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c 2023-07-17 12:11:30,485 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40781, inputRoot=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c 2023-07-17 12:11:30,486 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-360244873_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595890452, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595890452/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,486 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40781, inputRoot=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c, snapshotDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-17 12:11:30,500 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595890452/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-17 12:11:30,549 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:30,550 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:30,550 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:30,551 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:30,551 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:30,551 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:30,552 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:30,624 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/hadoop-4616104564725214968.jar 2023-07-17 12:11:30,624 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:30,625 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:30,625 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:30,626 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:30,627 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:30,627 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:30,628 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-17 12:11:30,628 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-17 12:11:30,629 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-17 12:11:30,629 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-17 12:11:30,630 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-17 12:11:30,630 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-17 12:11:30,631 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-17 12:11:30,631 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-17 12:11:30,632 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-17 12:11:30,632 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-17 12:11:30,633 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:11:30,633 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:11:30,634 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 12:11:30,634 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:11:30,634 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:11:30,635 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 12:11:30,636 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 12:11:30,933 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867780_0001_000001 (auth:SIMPLE) 2023-07-17 12:11:31,241 WARN [Listener at jenkins-hbase4.apache.org/42275] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-17 12:11:31,245 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-17 12:11:31,248 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-17 12:11:31,740 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 12:11:31,740 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 12:11:31,923 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867780_0002_000001 (auth:SIMPLE) 2023-07-17 12:11:32,160 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 12:11:36,762 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867780_0002_000001 (auth:SIMPLE) 2023-07-17 12:11:38,991 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867780_0002_000001 (auth:SIMPLE) 2023-07-17 12:11:41,915 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867780_0002_000001 (auth:SIMPLE) 2023-07-17 12:11:43,862 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-17 12:11:43,863 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-17 12:11:43,871 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-17 12:11:43,871 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-17 12:11:43,871 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-17 12:11:43,871 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-269744684_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-17 12:11:43,872 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(367): hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-17 12:11:43,872 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(367): hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-17 12:11:43,872 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-269744684_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595890452/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595890452/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-17 12:11:43,872 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(367): hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595890452/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-17 12:11:43,873 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(367): hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595890452/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-17 12:11:43,879 INFO [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-17 12:11:43,880 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-17 12:11:43,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-17 12:11:43,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-17 12:11:43,885 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595903885"}]},"ts":"1689595903885"} 2023-07-17 12:11:43,887 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-17 12:11:43,888 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-17 12:11:43,889 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=884e404dccbd089125d3e5d53f1680be, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6d85eef6cb250a32f438704e73bbf5ce, UNASSIGN}] 2023-07-17 12:11:43,892 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=884e404dccbd089125d3e5d53f1680be, UNASSIGN 2023-07-17 12:11:43,892 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6d85eef6cb250a32f438704e73bbf5ce, UNASSIGN 2023-07-17 12:11:43,893 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=884e404dccbd089125d3e5d53f1680be, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:43,893 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=6d85eef6cb250a32f438704e73bbf5ce, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:43,893 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689595887379.884e404dccbd089125d3e5d53f1680be.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689595903893"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595903893"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595903893"}]},"ts":"1689595903893"} 2023-07-17 12:11:43,893 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689595887379.6d85eef6cb250a32f438704e73bbf5ce.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689595903893"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595903893"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595903893"}]},"ts":"1689595903893"} 2023-07-17 12:11:43,895 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 884e404dccbd089125d3e5d53f1680be, server=jenkins-hbase4.apache.org,34107,1689595859757}] 2023-07-17 12:11:43,895 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 6d85eef6cb250a32f438704e73bbf5ce, server=jenkins-hbase4.apache.org,37767,1689595859826}] 2023-07-17 12:11:43,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-17 12:11:44,047 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 884e404dccbd089125d3e5d53f1680be 2023-07-17 12:11:44,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 884e404dccbd089125d3e5d53f1680be, disabling compactions & flushes 2023-07-17 12:11:44,047 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689595887379.884e404dccbd089125d3e5d53f1680be. 2023-07-17 12:11:44,048 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689595887379.884e404dccbd089125d3e5d53f1680be. 2023-07-17 12:11:44,048 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689595887379.884e404dccbd089125d3e5d53f1680be. after waiting 0 ms 2023-07-17 12:11:44,048 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689595887379.884e404dccbd089125d3e5d53f1680be. 2023-07-17 12:11:44,048 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6d85eef6cb250a32f438704e73bbf5ce 2023-07-17 12:11:44,048 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6d85eef6cb250a32f438704e73bbf5ce, disabling compactions & flushes 2023-07-17 12:11:44,048 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689595887379.6d85eef6cb250a32f438704e73bbf5ce. 2023-07-17 12:11:44,048 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689595887379.6d85eef6cb250a32f438704e73bbf5ce. 2023-07-17 12:11:44,048 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689595887379.6d85eef6cb250a32f438704e73bbf5ce. after waiting 0 ms 2023-07-17 12:11:44,048 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689595887379.6d85eef6cb250a32f438704e73bbf5ce. 2023-07-17 12:11:44,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemState/6d85eef6cb250a32f438704e73bbf5ce/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 12:11:44,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemState/884e404dccbd089125d3e5d53f1680be/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 12:11:44,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:11:44,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:11:44,063 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689595887379.6d85eef6cb250a32f438704e73bbf5ce. 2023-07-17 12:11:44,064 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6d85eef6cb250a32f438704e73bbf5ce: 2023-07-17 12:11:44,064 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689595887379.884e404dccbd089125d3e5d53f1680be. 2023-07-17 12:11:44,064 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 884e404dccbd089125d3e5d53f1680be: 2023-07-17 12:11:44,066 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 884e404dccbd089125d3e5d53f1680be 2023-07-17 12:11:44,066 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=884e404dccbd089125d3e5d53f1680be, regionState=CLOSED 2023-07-17 12:11:44,067 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689595887379.884e404dccbd089125d3e5d53f1680be.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689595904066"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595904066"}]},"ts":"1689595904066"} 2023-07-17 12:11:44,067 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6d85eef6cb250a32f438704e73bbf5ce 2023-07-17 12:11:44,067 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=6d85eef6cb250a32f438704e73bbf5ce, regionState=CLOSED 2023-07-17 12:11:44,067 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689595887379.6d85eef6cb250a32f438704e73bbf5ce.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689595904067"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595904067"}]},"ts":"1689595904067"} 2023-07-17 12:11:44,071 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-17 12:11:44,071 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 884e404dccbd089125d3e5d53f1680be, server=jenkins-hbase4.apache.org,34107,1689595859757 in 173 msec 2023-07-17 12:11:44,072 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-17 12:11:44,072 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 6d85eef6cb250a32f438704e73bbf5ce, server=jenkins-hbase4.apache.org,37767,1689595859826 in 174 msec 2023-07-17 12:11:44,072 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=884e404dccbd089125d3e5d53f1680be, UNASSIGN in 182 msec 2023-07-17 12:11:44,074 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-17 12:11:44,074 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6d85eef6cb250a32f438704e73bbf5ce, UNASSIGN in 183 msec 2023-07-17 12:11:44,075 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595904075"}]},"ts":"1689595904075"} 2023-07-17 12:11:44,076 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-17 12:11:44,077 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-17 12:11:44,079 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 198 msec 2023-07-17 12:11:44,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-17 12:11:44,187 INFO [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-17 12:11:44,188 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-17 12:11:44,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-17 12:11:44,192 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-17 12:11:44,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-17 12:11:44,193 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-17 12:11:44,194 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44163] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-17 12:11:44,198 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 12:11:44,198 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 12:11:44,198 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 12:11:44,198 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 12:11:44,199 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-17 12:11:44,199 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-17 12:11:44,199 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-17 12:11:44,199 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-17 12:11:44,200 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 12:11:44,200 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 12:11:44,200 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 12:11:44,200 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 12:11:44,200 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:11:44,200 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:11:44,200 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:11:44,200 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:11:44,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-17 12:11:44,203 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemState/884e404dccbd089125d3e5d53f1680be 2023-07-17 12:11:44,203 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemState/6d85eef6cb250a32f438704e73bbf5ce 2023-07-17 12:11:44,205 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemState/884e404dccbd089125d3e5d53f1680be/cf, FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemState/884e404dccbd089125d3e5d53f1680be/recovered.edits] 2023-07-17 12:11:44,205 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemState/6d85eef6cb250a32f438704e73bbf5ce/cf, FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemState/6d85eef6cb250a32f438704e73bbf5ce/recovered.edits] 2023-07-17 12:11:44,210 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemState/884e404dccbd089125d3e5d53f1680be/cf/989ba79d20044b08947f2cfa9a2b76af to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/archive/data/default/testtb-testExportFileSystemState/884e404dccbd089125d3e5d53f1680be/cf/989ba79d20044b08947f2cfa9a2b76af 2023-07-17 12:11:44,210 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemState/6d85eef6cb250a32f438704e73bbf5ce/cf/ee043e946e0a410680a1d936d5dfa25f to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/archive/data/default/testtb-testExportFileSystemState/6d85eef6cb250a32f438704e73bbf5ce/cf/ee043e946e0a410680a1d936d5dfa25f 2023-07-17 12:11:44,213 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemState/884e404dccbd089125d3e5d53f1680be/recovered.edits/9.seqid to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/archive/data/default/testtb-testExportFileSystemState/884e404dccbd089125d3e5d53f1680be/recovered.edits/9.seqid 2023-07-17 12:11:44,213 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemState/6d85eef6cb250a32f438704e73bbf5ce/recovered.edits/9.seqid to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/archive/data/default/testtb-testExportFileSystemState/6d85eef6cb250a32f438704e73bbf5ce/recovered.edits/9.seqid 2023-07-17 12:11:44,214 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemState/884e404dccbd089125d3e5d53f1680be 2023-07-17 12:11:44,214 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemState/6d85eef6cb250a32f438704e73bbf5ce 2023-07-17 12:11:44,214 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-17 12:11:44,217 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-17 12:11:44,219 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-17 12:11:44,221 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-17 12:11:44,223 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-17 12:11:44,223 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-17 12:11:44,223 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689595887379.884e404dccbd089125d3e5d53f1680be.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689595904223"}]},"ts":"9223372036854775807"} 2023-07-17 12:11:44,223 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689595887379.6d85eef6cb250a32f438704e73bbf5ce.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689595904223"}]},"ts":"9223372036854775807"} 2023-07-17 12:11:44,225 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-17 12:11:44,225 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 884e404dccbd089125d3e5d53f1680be, NAME => 'testtb-testExportFileSystemState,,1689595887379.884e404dccbd089125d3e5d53f1680be.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 6d85eef6cb250a32f438704e73bbf5ce, NAME => 'testtb-testExportFileSystemState,1,1689595887379.6d85eef6cb250a32f438704e73bbf5ce.', STARTKEY => '1', ENDKEY => ''}] 2023-07-17 12:11:44,225 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-17 12:11:44,225 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689595904225"}]},"ts":"9223372036854775807"} 2023-07-17 12:11:44,227 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-17 12:11:44,229 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-17 12:11:44,230 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 41 msec 2023-07-17 12:11:44,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-17 12:11:44,303 INFO [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-17 12:11:44,311 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-17 12:11:44,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-17 12:11:44,315 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-17 12:11:44,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-17 12:11:44,343 INFO [Listener at jenkins-hbase4.apache.org/42275] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=762 (was 756) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-269744684_17 at /127.0.0.1:56130 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x24b8e848-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1936 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-269744684_17 at /127.0.0.1:48192 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x24b8e848-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x24b8e848-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x24b8e848-shared-pool-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (905985230) connection to jenkins-hbase4.apache.org/172.31.14.131:41081 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1414535551_1 at /127.0.0.1:58796 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1414535551_1 at /127.0.0.1:48172 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-269744684_17 at /127.0.0.1:58810 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=923 (was 924), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=483 (was 524), ProcessCount=181 (was 180) - ProcessCount LEAK? -, AvailableMemoryMB=3051 (was 3153) 2023-07-17 12:11:44,343 WARN [Listener at jenkins-hbase4.apache.org/42275] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-17 12:11:44,364 INFO [Listener at jenkins-hbase4.apache.org/42275] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=762, OpenFileDescriptor=923, MaxFileDescriptor=60000, SystemLoadAverage=483, ProcessCount=181, AvailableMemoryMB=3050 2023-07-17 12:11:44,364 WARN [Listener at jenkins-hbase4.apache.org/42275] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-17 12:11:44,366 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-17 12:11:44,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-17 12:11:44,370 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 12:11:44,370 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-17 12:11:44,371 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 12:11:44,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-17 12:11:44,374 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testConsecutiveExports/69d3abde19806e9569c0608ba8dda407 2023-07-17 12:11:44,374 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testConsecutiveExports/fc67215270264d93b1baf010dd738f44 2023-07-17 12:11:44,375 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testConsecutiveExports/69d3abde19806e9569c0608ba8dda407 empty. 2023-07-17 12:11:44,375 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testConsecutiveExports/fc67215270264d93b1baf010dd738f44 empty. 2023-07-17 12:11:44,375 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testConsecutiveExports/69d3abde19806e9569c0608ba8dda407 2023-07-17 12:11:44,375 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testConsecutiveExports/fc67215270264d93b1baf010dd738f44 2023-07-17 12:11:44,376 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-17 12:11:44,400 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-17 12:11:44,401 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 69d3abde19806e9569c0608ba8dda407, NAME => 'testtb-testConsecutiveExports,,1689595904366.69d3abde19806e9569c0608ba8dda407.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp 2023-07-17 12:11:44,401 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => fc67215270264d93b1baf010dd738f44, NAME => 'testtb-testConsecutiveExports,1,1689595904366.fc67215270264d93b1baf010dd738f44.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp 2023-07-17 12:11:44,420 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689595904366.69d3abde19806e9569c0608ba8dda407.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:11:44,420 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 69d3abde19806e9569c0608ba8dda407, disabling compactions & flushes 2023-07-17 12:11:44,420 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689595904366.69d3abde19806e9569c0608ba8dda407. 2023-07-17 12:11:44,420 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689595904366.69d3abde19806e9569c0608ba8dda407. 2023-07-17 12:11:44,420 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689595904366.69d3abde19806e9569c0608ba8dda407. after waiting 0 ms 2023-07-17 12:11:44,420 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689595904366.69d3abde19806e9569c0608ba8dda407. 2023-07-17 12:11:44,420 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689595904366.69d3abde19806e9569c0608ba8dda407. 2023-07-17 12:11:44,420 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 69d3abde19806e9569c0608ba8dda407: 2023-07-17 12:11:44,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-17 12:11:44,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-17 12:11:44,820 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689595904366.fc67215270264d93b1baf010dd738f44.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:11:44,820 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing fc67215270264d93b1baf010dd738f44, disabling compactions & flushes 2023-07-17 12:11:44,820 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689595904366.fc67215270264d93b1baf010dd738f44. 2023-07-17 12:11:44,820 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689595904366.fc67215270264d93b1baf010dd738f44. 2023-07-17 12:11:44,820 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689595904366.fc67215270264d93b1baf010dd738f44. after waiting 0 ms 2023-07-17 12:11:44,820 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689595904366.fc67215270264d93b1baf010dd738f44. 2023-07-17 12:11:44,821 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689595904366.fc67215270264d93b1baf010dd738f44. 2023-07-17 12:11:44,821 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for fc67215270264d93b1baf010dd738f44: 2023-07-17 12:11:44,825 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 12:11:44,826 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689595904366.69d3abde19806e9569c0608ba8dda407.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689595904825"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595904825"}]},"ts":"1689595904825"} 2023-07-17 12:11:44,826 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689595904366.fc67215270264d93b1baf010dd738f44.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689595904825"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595904825"}]},"ts":"1689595904825"} 2023-07-17 12:11:44,830 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-17 12:11:44,832 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 12:11:44,832 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595904832"}]},"ts":"1689595904832"} 2023-07-17 12:11:44,836 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-17 12:11:44,840 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 12:11:44,842 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 12:11:44,842 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 12:11:44,842 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 12:11:44,842 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 12:11:44,842 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=69d3abde19806e9569c0608ba8dda407, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=fc67215270264d93b1baf010dd738f44, ASSIGN}] 2023-07-17 12:11:44,848 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=fc67215270264d93b1baf010dd738f44, ASSIGN 2023-07-17 12:11:44,848 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=69d3abde19806e9569c0608ba8dda407, ASSIGN 2023-07-17 12:11:44,852 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=69d3abde19806e9569c0608ba8dda407, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34107,1689595859757; forceNewPlan=false, retain=false 2023-07-17 12:11:44,852 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=fc67215270264d93b1baf010dd738f44, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37767,1689595859826; forceNewPlan=false, retain=false 2023-07-17 12:11:44,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-17 12:11:45,003 INFO [jenkins-hbase4:35573] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-17 12:11:45,005 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=fc67215270264d93b1baf010dd738f44, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:45,005 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=69d3abde19806e9569c0608ba8dda407, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:45,006 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689595904366.fc67215270264d93b1baf010dd738f44.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689595905005"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595905005"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595905005"}]},"ts":"1689595905005"} 2023-07-17 12:11:45,006 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689595904366.69d3abde19806e9569c0608ba8dda407.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689595905005"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595905005"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595905005"}]},"ts":"1689595905005"} 2023-07-17 12:11:45,008 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure fc67215270264d93b1baf010dd738f44, server=jenkins-hbase4.apache.org,37767,1689595859826}] 2023-07-17 12:11:45,009 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 69d3abde19806e9569c0608ba8dda407, server=jenkins-hbase4.apache.org,34107,1689595859757}] 2023-07-17 12:11:45,164 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689595904366.fc67215270264d93b1baf010dd738f44. 2023-07-17 12:11:45,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fc67215270264d93b1baf010dd738f44, NAME => 'testtb-testConsecutiveExports,1,1689595904366.fc67215270264d93b1baf010dd738f44.', STARTKEY => '1', ENDKEY => ''} 2023-07-17 12:11:45,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689595904366.fc67215270264d93b1baf010dd738f44. service=AccessControlService 2023-07-17 12:11:45,165 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 12:11:45,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports fc67215270264d93b1baf010dd738f44 2023-07-17 12:11:45,165 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689595904366.69d3abde19806e9569c0608ba8dda407. 2023-07-17 12:11:45,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689595904366.fc67215270264d93b1baf010dd738f44.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:11:45,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 69d3abde19806e9569c0608ba8dda407, NAME => 'testtb-testConsecutiveExports,,1689595904366.69d3abde19806e9569c0608ba8dda407.', STARTKEY => '', ENDKEY => '1'} 2023-07-17 12:11:45,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fc67215270264d93b1baf010dd738f44 2023-07-17 12:11:45,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fc67215270264d93b1baf010dd738f44 2023-07-17 12:11:45,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689595904366.69d3abde19806e9569c0608ba8dda407. service=AccessControlService 2023-07-17 12:11:45,166 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 12:11:45,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 69d3abde19806e9569c0608ba8dda407 2023-07-17 12:11:45,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689595904366.69d3abde19806e9569c0608ba8dda407.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:11:45,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 69d3abde19806e9569c0608ba8dda407 2023-07-17 12:11:45,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 69d3abde19806e9569c0608ba8dda407 2023-07-17 12:11:45,192 INFO [StoreOpener-fc67215270264d93b1baf010dd738f44-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fc67215270264d93b1baf010dd738f44 2023-07-17 12:11:45,192 INFO [StoreOpener-69d3abde19806e9569c0608ba8dda407-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 69d3abde19806e9569c0608ba8dda407 2023-07-17 12:11:45,194 DEBUG [StoreOpener-69d3abde19806e9569c0608ba8dda407-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testConsecutiveExports/69d3abde19806e9569c0608ba8dda407/cf 2023-07-17 12:11:45,194 DEBUG [StoreOpener-69d3abde19806e9569c0608ba8dda407-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testConsecutiveExports/69d3abde19806e9569c0608ba8dda407/cf 2023-07-17 12:11:45,195 DEBUG [StoreOpener-fc67215270264d93b1baf010dd738f44-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testConsecutiveExports/fc67215270264d93b1baf010dd738f44/cf 2023-07-17 12:11:45,195 DEBUG [StoreOpener-fc67215270264d93b1baf010dd738f44-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testConsecutiveExports/fc67215270264d93b1baf010dd738f44/cf 2023-07-17 12:11:45,195 INFO [StoreOpener-69d3abde19806e9569c0608ba8dda407-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 69d3abde19806e9569c0608ba8dda407 columnFamilyName cf 2023-07-17 12:11:45,196 INFO [StoreOpener-69d3abde19806e9569c0608ba8dda407-1] regionserver.HStore(310): Store=69d3abde19806e9569c0608ba8dda407/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 12:11:45,196 INFO [StoreOpener-fc67215270264d93b1baf010dd738f44-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fc67215270264d93b1baf010dd738f44 columnFamilyName cf 2023-07-17 12:11:45,197 INFO [StoreOpener-fc67215270264d93b1baf010dd738f44-1] regionserver.HStore(310): Store=fc67215270264d93b1baf010dd738f44/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 12:11:45,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testConsecutiveExports/69d3abde19806e9569c0608ba8dda407 2023-07-17 12:11:45,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testConsecutiveExports/69d3abde19806e9569c0608ba8dda407 2023-07-17 12:11:45,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testConsecutiveExports/fc67215270264d93b1baf010dd738f44 2023-07-17 12:11:45,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testConsecutiveExports/fc67215270264d93b1baf010dd738f44 2023-07-17 12:11:45,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 69d3abde19806e9569c0608ba8dda407 2023-07-17 12:11:45,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fc67215270264d93b1baf010dd738f44 2023-07-17 12:11:45,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testConsecutiveExports/69d3abde19806e9569c0608ba8dda407/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 12:11:45,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testConsecutiveExports/fc67215270264d93b1baf010dd738f44/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 12:11:45,211 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 69d3abde19806e9569c0608ba8dda407; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73795386, jitterRate=0.09963694214820862}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 12:11:45,211 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fc67215270264d93b1baf010dd738f44; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59030353, jitterRate=-0.12037919461727142}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 12:11:45,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 69d3abde19806e9569c0608ba8dda407: 2023-07-17 12:11:45,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fc67215270264d93b1baf010dd738f44: 2023-07-17 12:11:45,212 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689595904366.fc67215270264d93b1baf010dd738f44., pid=45, masterSystemTime=1689595905160 2023-07-17 12:11:45,212 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689595904366.69d3abde19806e9569c0608ba8dda407., pid=46, masterSystemTime=1689595905161 2023-07-17 12:11:45,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689595904366.fc67215270264d93b1baf010dd738f44. 2023-07-17 12:11:45,214 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689595904366.fc67215270264d93b1baf010dd738f44. 2023-07-17 12:11:45,215 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=fc67215270264d93b1baf010dd738f44, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:45,215 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689595904366.fc67215270264d93b1baf010dd738f44.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689595905215"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689595905215"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689595905215"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689595905215"}]},"ts":"1689595905215"} 2023-07-17 12:11:45,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689595904366.69d3abde19806e9569c0608ba8dda407. 2023-07-17 12:11:45,216 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689595904366.69d3abde19806e9569c0608ba8dda407. 2023-07-17 12:11:45,216 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=69d3abde19806e9569c0608ba8dda407, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:45,217 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689595904366.69d3abde19806e9569c0608ba8dda407.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689595905216"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689595905216"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689595905216"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689595905216"}]},"ts":"1689595905216"} 2023-07-17 12:11:45,220 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-17 12:11:45,220 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure fc67215270264d93b1baf010dd738f44, server=jenkins-hbase4.apache.org,37767,1689595859826 in 210 msec 2023-07-17 12:11:45,222 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-17 12:11:45,222 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 69d3abde19806e9569c0608ba8dda407, server=jenkins-hbase4.apache.org,34107,1689595859757 in 210 msec 2023-07-17 12:11:45,222 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=fc67215270264d93b1baf010dd738f44, ASSIGN in 378 msec 2023-07-17 12:11:45,224 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-17 12:11:45,224 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=69d3abde19806e9569c0608ba8dda407, ASSIGN in 380 msec 2023-07-17 12:11:45,225 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 12:11:45,225 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595905225"}]},"ts":"1689595905225"} 2023-07-17 12:11:45,227 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-17 12:11:45,230 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 12:11:45,230 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-17 12:11:45,232 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44163] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-17 12:11:45,235 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:11:45,235 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:11:45,235 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:11:45,235 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:11:45,237 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-17 12:11:45,237 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-17 12:11:45,237 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-17 12:11:45,237 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-17 12:11:45,239 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 871 msec 2023-07-17 12:11:45,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-17 12:11:45,477 INFO [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-17 12:11:45,477 DEBUG [Listener at jenkins-hbase4.apache.org/42275] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-17 12:11:45,477 INFO [Listener at jenkins-hbase4.apache.org/42275] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 12:11:45,480 INFO [Listener at jenkins-hbase4.apache.org/42275] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-17 12:11:45,480 INFO [Listener at jenkins-hbase4.apache.org/42275] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 12:11:45,481 INFO [Listener at jenkins-hbase4.apache.org/42275] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-17 12:11:45,483 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-17 12:11:45,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689595905483 (current time:1689595905483). 2023-07-17 12:11:45,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 12:11:45,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(139): Connect 0x3a9520dc to 127.0.0.1:60075 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:11:45,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2fd9a49e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:11:45,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:11:45,494 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55436, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:11:45,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3a9520dc to 127.0.0.1:60075 2023-07-17 12:11:45,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:11:45,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(139): Connect 0x13070bc7 to 127.0.0.1:60075 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:11:45,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74abb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:11:45,503 DEBUG [hconnection-0x6298e371-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:11:45,508 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55452, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:11:45,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:11:45,513 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40518, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:11:45,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x13070bc7 to 127.0.0.1:60075 2023-07-17 12:11:45,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:11:45,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-17 12:11:45,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 12:11:45,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-17 12:11:45,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-17 12:11:45,521 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-17 12:11:45,521 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689596505521 2023-07-17 12:11:45,521 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-17 12:11:45,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-17 12:11:45,523 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 12:11:45,523 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 12:11:45,524 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-17 12:11:45,525 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-17 12:11:45,527 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-07-17 12:11:45,528 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-17 12:11:45,530 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689596505530 2023-07-17 12:11:45,549 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,550 INFO [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-17 12:11:45,550 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:11:45,551 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-17 12:11:45,551 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-17 12:11:45,552 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,552 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,553 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:45,553 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:45,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:45,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:45,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:45,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:45,553 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:45,553 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:45,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:45,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:45,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,554 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:45,554 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:45,554 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,554 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,554 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,554 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:45,554 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 12:11:45,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-17 12:11:45,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-17 12:11:45,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-17 12:11:45,555 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-17 12:11:45,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,554 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-17 12:11:45,555 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-17 12:11:45,555 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,555 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,555 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,555 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-17 12:11:45,555 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-17 12:11:45,555 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:11:45,555 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-17 12:11:45,556 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-17 12:11:45,556 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-17 12:11:45,556 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44163,1689595859880' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-17 12:11:45,556 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:11:45,555 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:11:45,558 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-17 12:11:45,561 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-17 12:11:45,561 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34107,1689595859757' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-17 12:11:45,561 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-17 12:11:45,561 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-17 12:11:45,561 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37767,1689595859826' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-17 12:11:45,562 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,564 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:45,564 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:45,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:45,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:45,565 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:45,565 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,565 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,565 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:11:45,565 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,565 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:11:45,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:45,565 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,565 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:11:45,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:45,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:45,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:45,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:45,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:45,567 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34107,1689595859757' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-17 12:11:45,567 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b6e0d2b[Count = 1] remaining members to acquire global barrier 2023-07-17 12:11:45,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:45,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:45,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:45,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:45,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:45,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:45,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:45,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:45,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:45,569 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37767,1689595859826' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-17 12:11:45,569 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b6e0d2b[Count = 0] remaining members to acquire global barrier 2023-07-17 12:11:45,570 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-17 12:11:45,570 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,571 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,571 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,571 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:45,571 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,571 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-17 12:11:45,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,571 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:11:45,571 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-17 12:11:45,571 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689595904366.fc67215270264d93b1baf010dd738f44. 2023-07-17 12:11:45,571 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-17 12:11:45,571 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-17 12:11:45,571 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689595904366.fc67215270264d93b1baf010dd738f44. started... 2023-07-17 12:11:45,571 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44163,1689595859880' in zk 2023-07-17 12:11:45,571 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:11:45,571 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:45,572 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 12:11:45,571 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:11:45,573 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fc67215270264d93b1baf010dd738f44: 2023-07-17 12:11:45,573 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:11:45,572 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689595904366.69d3abde19806e9569c0608ba8dda407. 2023-07-17 12:11:45,573 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689595904366.69d3abde19806e9569c0608ba8dda407. started... 2023-07-17 12:11:45,573 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689595904366.fc67215270264d93b1baf010dd738f44.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,574 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:11:45,574 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 69d3abde19806e9569c0608ba8dda407: 2023-07-17 12:11:45,574 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 12:11:45,575 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689595904366.69d3abde19806e9569c0608ba8dda407.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,575 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:11:45,575 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 12:11:45,581 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-17 12:11:45,581 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:11:45,581 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-17 12:11:45,587 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689595904366.fc67215270264d93b1baf010dd738f44. completed. 2023-07-17 12:11:45,587 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689595904366.fc67215270264d93b1baf010dd738f44. 2023-07-17 12:11:45,587 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:11:45,587 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:11:45,587 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689595904366.69d3abde19806e9569c0608ba8dda407. completed. 2023-07-17 12:11:45,587 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:45,587 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689595904366.69d3abde19806e9569c0608ba8dda407. 2023-07-17 12:11:45,588 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-17 12:11:45,588 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:11:45,588 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:11:45,588 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:45,588 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37767,1689595859826' in zk 2023-07-17 12:11:45,588 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-17 12:11:45,588 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34107,1689595859757' in zk 2023-07-17 12:11:45,589 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-17 12:11:45,589 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-17 12:11:45,589 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:45,589 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:11:45,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:45,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:45,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:45,589 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:45,589 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:11:45,589 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-17 12:11:45,591 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-17 12:11:45,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:45,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:45,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:45,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:45,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:45,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:45,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:45,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:45,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:45,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37767,1689595859826': 2023-07-17 12:11:45,595 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37767,1689595859826' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-17 12:11:45,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:45,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:45,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:45,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:45,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:45,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:45,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:45,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:45,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:45,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:45,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:45,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:45,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34107,1689595859757': 2023-07-17 12:11:45,599 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34107,1689595859757' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-17 12:11:45,599 INFO [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-17 12:11:45,599 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 12:11:45,599 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 12:11:45,600 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,600 INFO [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 12:11:45,601 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,601 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,601 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:45,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:45,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:45,601 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,601 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,601 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:45,601 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:45,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:45,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,602 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:45,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:45,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:45,602 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:45,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:45,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:45,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:45,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:45,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:45,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,603 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:45,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:45,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:45,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:45,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:45,608 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:45,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,608 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:45,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:45,609 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:45,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:45,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:45,612 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:45,612 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,612 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:45,612 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:45,612 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:45,612 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:45,612 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:45,612 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:45,612 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:45,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:45,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:45,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:45,612 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:45,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:45,613 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:45,613 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:11:45,613 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:45,613 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:45,615 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:45,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:45,615 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:45,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:45,615 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:45,615 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,615 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:45,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:45,613 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:45,616 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,623 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:11:45,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-17 12:11:45,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:11:45,624 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 12:11:45,638 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,666 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-17 12:11:45,666 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,667 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-17 12:11:45,667 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689595905521Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689595905613 (+92 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689595905615 (+2 ms)Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689595905619 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689595905631 (+12 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689595905666 (+35 ms) 2023-07-17 12:11:45,669 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-17 12:11:45,672 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 146 msec 2023-07-17 12:11:45,825 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:11:45,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-17 12:11:45,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 12:11:45,835 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34107] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689595904366.69d3abde19806e9569c0608ba8dda407. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 12:11:45,836 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37767] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689595904366.fc67215270264d93b1baf010dd738f44. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 12:11:45,840 DEBUG [Listener at jenkins-hbase4.apache.org/42275] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-17 12:11:45,840 DEBUG [Listener at jenkins-hbase4.apache.org/42275] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689595904366.69d3abde19806e9569c0608ba8dda407. 2023-07-17 12:11:45,840 INFO [Listener at jenkins-hbase4.apache.org/42275] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 12:11:45,883 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-17 12:11:45,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689595905883 (current time:1689595905883). 2023-07-17 12:11:45,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 12:11:45,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(139): Connect 0x3bbce983 to 127.0.0.1:60075 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:11:45,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@30fc1640, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:11:45,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:11:45,915 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55464, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:11:45,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3bbce983 to 127.0.0.1:60075 2023-07-17 12:11:45,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:11:45,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(139): Connect 0x22a58658 to 127.0.0.1:60075 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:11:45,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e89937e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:11:45,927 DEBUG [hconnection-0x2e17c4f9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:11:45,931 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55468, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:11:45,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:11:45,939 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40526, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:11:45,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x22a58658 to 127.0.0.1:60075 2023-07-17 12:11:45,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:11:45,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-17 12:11:45,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 12:11:45,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-17 12:11:45,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-17 12:11:45,948 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-17 12:11:45,950 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689596505950 2023-07-17 12:11:45,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-17 12:11:45,950 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-17 12:11:45,954 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 12:11:45,954 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 12:11:45,956 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-17 12:11:45,956 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-17 12:11:45,964 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 12 msec 2023-07-17 12:11:45,966 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-17 12:11:45,967 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689596505967 2023-07-17 12:11:45,989 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-17 12:11:45,989 INFO [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-17 12:11:45,989 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:11:45,991 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-17 12:11:45,991 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-17 12:11:45,991 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 12:11:45,991 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 12:11:45,994 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:45,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:45,994 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:45,994 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:45,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:45,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:45,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:45,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:45,994 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:45,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:45,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 12:11:45,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 12:11:45,995 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:45,995 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:45,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 12:11:45,995 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 12:11:45,995 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:45,995 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 12:11:45,995 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 12:11:45,995 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 12:11:45,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-17 12:11:45,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 12:11:45,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-17 12:11:45,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 12:11:45,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-17 12:11:45,998 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-17 12:11:45,998 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-17 12:11:45,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 12:11:45,999 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-17 12:11:45,999 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-17 12:11:45,999 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-17 12:11:45,999 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-17 12:11:45,999 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:11:45,999 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-17 12:11:45,999 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-17 12:11:46,000 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-17 12:11:46,001 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-17 12:11:46,001 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:11:46,000 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:11:46,002 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-17 12:11:46,003 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-17 12:11:46,003 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-17 12:11:46,001 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-17 12:11:46,003 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37767,1689595859826' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-17 12:11:46,003 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-17 12:11:46,003 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34107,1689595859757' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-17 12:11:46,003 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44163,1689595859880' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-17 12:11:46,005 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,005 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:46,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:46,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:46,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:46,005 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:46,006 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:46,006 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,006 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:11:46,006 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:46,006 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,006 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:11:46,006 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,006 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:11:46,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 12:11:46,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:46,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:46,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:46,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:46,008 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37767,1689595859826' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-17 12:11:46,008 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a2cc012[Count = 1] remaining members to acquire global barrier 2023-07-17 12:11:46,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:46,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:46,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:46,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:46,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:46,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 12:11:46,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:46,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:46,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:46,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:46,011 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34107,1689595859757' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-17 12:11:46,011 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a2cc012[Count = 0] remaining members to acquire global barrier 2023-07-17 12:11:46,011 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-17 12:11:46,012 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,013 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,013 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,013 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,013 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-17 12:11:46,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,013 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:11:46,013 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-17 12:11:46,013 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-17 12:11:46,013 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:46,013 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-17 12:11:46,013 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:11:46,014 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:11:46,014 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689595904366.69d3abde19806e9569c0608ba8dda407. 2023-07-17 12:11:46,014 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44163,1689595859880' in zk 2023-07-17 12:11:46,014 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689595904366.69d3abde19806e9569c0608ba8dda407. started... 2023-07-17 12:11:46,014 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:11:46,014 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:46,014 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 12:11:46,014 INFO [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 69d3abde19806e9569c0608ba8dda407 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-17 12:11:46,014 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689595904366.fc67215270264d93b1baf010dd738f44. 2023-07-17 12:11:46,014 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689595904366.fc67215270264d93b1baf010dd738f44. started... 2023-07-17 12:11:46,014 INFO [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] regionserver.HRegion(2745): Flushing fc67215270264d93b1baf010dd738f44 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-17 12:11:46,017 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-17 12:11:46,017 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:11:46,017 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-17 12:11:46,042 INFO [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testConsecutiveExports/69d3abde19806e9569c0608ba8dda407/.tmp/cf/83afb7b7239743bcba614900999b9dc4 2023-07-17 12:11:46,044 INFO [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testConsecutiveExports/fc67215270264d93b1baf010dd738f44/.tmp/cf/afa4e8f19cfa409090d238deaee2e0ea 2023-07-17 12:11:46,050 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testConsecutiveExports/69d3abde19806e9569c0608ba8dda407/.tmp/cf/83afb7b7239743bcba614900999b9dc4 as hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testConsecutiveExports/69d3abde19806e9569c0608ba8dda407/cf/83afb7b7239743bcba614900999b9dc4 2023-07-17 12:11:46,050 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testConsecutiveExports/fc67215270264d93b1baf010dd738f44/.tmp/cf/afa4e8f19cfa409090d238deaee2e0ea as hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testConsecutiveExports/fc67215270264d93b1baf010dd738f44/cf/afa4e8f19cfa409090d238deaee2e0ea 2023-07-17 12:11:46,054 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:11:46,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-17 12:11:46,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:11:46,055 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 12:11:46,056 INFO [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testConsecutiveExports/fc67215270264d93b1baf010dd738f44/cf/afa4e8f19cfa409090d238deaee2e0ea, entries=47, sequenceid=6, filesize=8.0 K 2023-07-17 12:11:46,057 INFO [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testConsecutiveExports/69d3abde19806e9569c0608ba8dda407/cf/83afb7b7239743bcba614900999b9dc4, entries=3, sequenceid=6, filesize=5.0 K 2023-07-17 12:11:46,058 INFO [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for fc67215270264d93b1baf010dd738f44 in 43ms, sequenceid=6, compaction requested=false 2023-07-17 12:11:46,058 INFO [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 69d3abde19806e9569c0608ba8dda407 in 44ms, sequenceid=6, compaction requested=false 2023-07-17 12:11:46,058 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-17 12:11:46,058 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-17 12:11:46,060 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fc67215270264d93b1baf010dd738f44: 2023-07-17 12:11:46,060 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689595904366.fc67215270264d93b1baf010dd738f44.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-17 12:11:46,060 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:11:46,060 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testConsecutiveExports/fc67215270264d93b1baf010dd738f44/cf/afa4e8f19cfa409090d238deaee2e0ea] hfiles 2023-07-17 12:11:46,060 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testConsecutiveExports/fc67215270264d93b1baf010dd738f44/cf/afa4e8f19cfa409090d238deaee2e0ea for snapshot=snaptb0-testConsecutiveExports 2023-07-17 12:11:46,060 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 69d3abde19806e9569c0608ba8dda407: 2023-07-17 12:11:46,060 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689595904366.69d3abde19806e9569c0608ba8dda407.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-17 12:11:46,060 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:11:46,060 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testConsecutiveExports/69d3abde19806e9569c0608ba8dda407/cf/83afb7b7239743bcba614900999b9dc4] hfiles 2023-07-17 12:11:46,060 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testConsecutiveExports/69d3abde19806e9569c0608ba8dda407/cf/83afb7b7239743bcba614900999b9dc4 for snapshot=snaptb0-testConsecutiveExports 2023-07-17 12:11:46,089 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689595904366.69d3abde19806e9569c0608ba8dda407. completed. 2023-07-17 12:11:46,089 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689595904366.69d3abde19806e9569c0608ba8dda407. 2023-07-17 12:11:46,090 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:11:46,090 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:11:46,090 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:46,090 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-17 12:11:46,090 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34107,1689595859757' in zk 2023-07-17 12:11:46,092 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:46,092 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-17 12:11:46,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:46,092 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:11:46,092 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-17 12:11:46,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:46,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:46,092 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689595904366.fc67215270264d93b1baf010dd738f44. completed. 2023-07-17 12:11:46,095 DEBUG [rs(jenkins-hbase4.apache.org,37767,1689595859826)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689595904366.fc67215270264d93b1baf010dd738f44. 2023-07-17 12:11:46,095 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:11:46,095 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:11:46,095 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:46,095 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-17 12:11:46,095 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37767,1689595859826' in zk 2023-07-17 12:11:46,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:46,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:46,097 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-17 12:11:46,097 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:46,097 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:11:46,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 12:11:46,097 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-17 12:11:46,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:46,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:46,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:46,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:46,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 12:11:46,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:46,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:46,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:46,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34107,1689595859757': 2023-07-17 12:11:46,102 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34107,1689595859757' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-17 12:11:46,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:46,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:46,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:46,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:46,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:46,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 12:11:46,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:46,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:46,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:46,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:46,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 12:11:46,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:46,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:46,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:46,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37767,1689595859826': 2023-07-17 12:11:46,106 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37767,1689595859826' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-17 12:11:46,106 INFO [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-17 12:11:46,106 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 12:11:46,106 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 12:11:46,106 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-17 12:11:46,106 INFO [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 12:11:46,108 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,108 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:11:46,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:11:46,108 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:46,108 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,108 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,109 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:46,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:11:46,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:46,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:46,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 12:11:46,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:11:46,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 12:11:46,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:46,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:46,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,109 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:46,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,109 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:46,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:46,111 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:46,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:46,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:46,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:11:46,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:46,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:46,111 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:46,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 12:11:46,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:46,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:46,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:46,113 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:46,114 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:46,114 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:46,123 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:46,123 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:46,123 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:46,123 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:46,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:46,123 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:46,123 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:46,123 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,123 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:11:46,123 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,123 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:11:46,123 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:46,123 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:46,123 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:11:46,123 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:11:46,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:46,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:46,123 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-17 12:11:46,123 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:11:46,124 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-17 12:11:46,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:11:46,123 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,124 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,123 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:11:46,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:11:46,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:46,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:46,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:46,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:11:46,126 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:46,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:11:46,164 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,211 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-17 12:11:46,211 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,211 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,211 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689595905951Consolidate snapshot: snaptb0-testConsecutiveExports at 1689595906124 (+173 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1689595906124Writing data manifest for snaptb0-testConsecutiveExports at 1689595906139 (+15 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689595906155 (+16 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689595906211 (+56 ms) 2023-07-17 12:11:46,214 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-17 12:11:46,216 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 261 msec 2023-07-17 12:11:46,256 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:11:46,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-17 12:11:46,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 12:11:46,263 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/local-export-1689595906263 2023-07-17 12:11:46,263 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/local-export-1689595906263, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/local-export-1689595906263, srcFsUri=hdfs://localhost:40781, srcDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c 2023-07-17 12:11:46,289 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40781, inputRoot=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c 2023-07-17 12:11:46,289 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@36e5fdd4, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/local-export-1689595906263, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/local-export-1689595906263/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,289 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40781, inputRoot=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c, snapshotDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-17 12:11:46,297 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/local-export-1689595906263/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-17 12:11:46,311 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:46,312 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:46,312 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:46,312 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:46,313 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:46,313 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:46,313 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:46,381 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/hadoop-1627634873752419892.jar 2023-07-17 12:11:46,382 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:46,382 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:46,383 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:46,383 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:46,383 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:46,383 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:46,384 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-17 12:11:46,384 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-17 12:11:46,385 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-17 12:11:46,385 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-17 12:11:46,385 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-17 12:11:46,386 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-17 12:11:46,386 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-17 12:11:46,386 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-17 12:11:46,387 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-17 12:11:46,387 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-17 12:11:46,388 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:11:46,388 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:11:46,388 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 12:11:46,389 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:11:46,389 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:11:46,389 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 12:11:46,390 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 12:11:46,823 WARN [Listener at jenkins-hbase4.apache.org/42275] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-17 12:11:46,825 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-17 12:11:46,828 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-17 12:11:48,115 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 12:11:48,115 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 12:11:48,118 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867780_0002_000001 (auth:SIMPLE) 2023-07-17 12:11:48,177 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867780_0003_000001 (auth:SIMPLE) 2023-07-17 12:11:49,661 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 12:11:52,426 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867780_0003_000001 (auth:SIMPLE) 2023-07-17 12:11:54,693 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867780_0003_000001 (auth:SIMPLE) 2023-07-17 12:11:57,710 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867780_0003_000001 (auth:SIMPLE) 2023-07-17 12:11:59,034 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-17 12:11:59,035 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-17 12:11:59,042 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-17 12:11:59,042 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-17 12:11:59,043 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-17 12:11:59,043 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-269744684_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-17 12:11:59,044 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(367): hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-17 12:11:59,044 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(367): hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-17 12:11:59,044 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@4a3e35a5 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/local-export-1689595906263/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/local-export-1689595906263/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-17 12:11:59,044 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/local-export-1689595906263/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-17 12:11:59,044 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/local-export-1689595906263/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-17 12:11:59,046 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/local-export-1689595906263, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/local-export-1689595906263, srcFsUri=hdfs://localhost:40781, srcDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c 2023-07-17 12:11:59,074 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40781, inputRoot=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c 2023-07-17 12:11:59,074 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@51d4a123, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/local-export-1689595906263, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/local-export-1689595906263/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-17 12:11:59,074 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40781, inputRoot=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c, snapshotDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-17 12:11:59,089 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/local-export-1689595906263/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-17 12:11:59,121 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:59,122 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:59,122 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:59,123 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:59,123 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:59,123 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:59,124 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:59,215 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/hadoop-3629385512976072314.jar 2023-07-17 12:11:59,216 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:59,216 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:59,217 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:59,217 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:59,218 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:59,218 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-17 12:11:59,218 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-17 12:11:59,219 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-17 12:11:59,219 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-17 12:11:59,220 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-17 12:11:59,220 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-17 12:11:59,221 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-17 12:11:59,221 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-17 12:11:59,221 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-17 12:11:59,222 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-17 12:11:59,222 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-17 12:11:59,223 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:11:59,223 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:11:59,224 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 12:11:59,224 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:11:59,224 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:11:59,225 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 12:11:59,225 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 12:11:59,606 WARN [Listener at jenkins-hbase4.apache.org/42275] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-17 12:11:59,609 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-17 12:11:59,611 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-17 12:12:03,889 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 12:12:03,889 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 12:12:03,893 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867780_0003_000001 (auth:SIMPLE) 2023-07-17 12:12:04,689 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867780_0004_000001 (auth:SIMPLE) 2023-07-17 12:12:09,210 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867780_0004_000001 (auth:SIMPLE) 2023-07-17 12:12:11,444 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867780_0004_000001 (auth:SIMPLE) 2023-07-17 12:12:14,912 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867780_0004_000001 (auth:SIMPLE) 2023-07-17 12:12:16,877 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-17 12:12:16,878 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-17 12:12:16,887 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-17 12:12:16,887 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-17 12:12:16,888 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-17 12:12:16,888 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-269744684_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-17 12:12:16,898 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(367): hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-17 12:12:16,898 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(367): hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-17 12:12:16,898 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@4a3e35a5 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/local-export-1689595906263/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/local-export-1689595906263/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-17 12:12:16,899 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/local-export-1689595906263/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-17 12:12:16,899 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/local-export-1689595906263/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-17 12:12:16,930 INFO [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-17 12:12:16,932 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-17 12:12:16,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-17 12:12:16,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-17 12:12:16,941 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595936941"}]},"ts":"1689595936941"} 2023-07-17 12:12:16,943 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-17 12:12:16,945 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-17 12:12:16,947 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=69d3abde19806e9569c0608ba8dda407, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=fc67215270264d93b1baf010dd738f44, UNASSIGN}] 2023-07-17 12:12:16,948 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=fc67215270264d93b1baf010dd738f44, UNASSIGN 2023-07-17 12:12:16,950 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=69d3abde19806e9569c0608ba8dda407, UNASSIGN 2023-07-17 12:12:16,951 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=69d3abde19806e9569c0608ba8dda407, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:16,951 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689595904366.69d3abde19806e9569c0608ba8dda407.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689595936951"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595936951"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595936951"}]},"ts":"1689595936951"} 2023-07-17 12:12:16,952 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=fc67215270264d93b1baf010dd738f44, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:16,952 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689595904366.fc67215270264d93b1baf010dd738f44.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689595936952"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595936952"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595936952"}]},"ts":"1689595936952"} 2023-07-17 12:12:16,954 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 69d3abde19806e9569c0608ba8dda407, server=jenkins-hbase4.apache.org,34107,1689595859757}] 2023-07-17 12:12:16,955 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure fc67215270264d93b1baf010dd738f44, server=jenkins-hbase4.apache.org,37767,1689595859826}] 2023-07-17 12:12:17,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-17 12:12:17,108 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 69d3abde19806e9569c0608ba8dda407 2023-07-17 12:12:17,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 69d3abde19806e9569c0608ba8dda407, disabling compactions & flushes 2023-07-17 12:12:17,108 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689595904366.69d3abde19806e9569c0608ba8dda407. 2023-07-17 12:12:17,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689595904366.69d3abde19806e9569c0608ba8dda407. 2023-07-17 12:12:17,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689595904366.69d3abde19806e9569c0608ba8dda407. after waiting 0 ms 2023-07-17 12:12:17,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689595904366.69d3abde19806e9569c0608ba8dda407. 2023-07-17 12:12:17,109 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close fc67215270264d93b1baf010dd738f44 2023-07-17 12:12:17,109 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fc67215270264d93b1baf010dd738f44, disabling compactions & flushes 2023-07-17 12:12:17,109 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689595904366.fc67215270264d93b1baf010dd738f44. 2023-07-17 12:12:17,109 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689595904366.fc67215270264d93b1baf010dd738f44. 2023-07-17 12:12:17,109 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689595904366.fc67215270264d93b1baf010dd738f44. after waiting 0 ms 2023-07-17 12:12:17,109 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689595904366.fc67215270264d93b1baf010dd738f44. 2023-07-17 12:12:17,202 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testConsecutiveExports/69d3abde19806e9569c0608ba8dda407/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 12:12:17,204 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:12:17,206 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689595904366.69d3abde19806e9569c0608ba8dda407. 2023-07-17 12:12:17,207 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 69d3abde19806e9569c0608ba8dda407: 2023-07-17 12:12:17,211 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 69d3abde19806e9569c0608ba8dda407 2023-07-17 12:12:17,212 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=69d3abde19806e9569c0608ba8dda407, regionState=CLOSED 2023-07-17 12:12:17,212 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689595904366.69d3abde19806e9569c0608ba8dda407.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689595937212"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595937212"}]},"ts":"1689595937212"} 2023-07-17 12:12:17,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testConsecutiveExports/fc67215270264d93b1baf010dd738f44/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 12:12:17,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:12:17,222 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689595904366.fc67215270264d93b1baf010dd738f44. 2023-07-17 12:12:17,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fc67215270264d93b1baf010dd738f44: 2023-07-17 12:12:17,223 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-17 12:12:17,223 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 69d3abde19806e9569c0608ba8dda407, server=jenkins-hbase4.apache.org,34107,1689595859757 in 264 msec 2023-07-17 12:12:17,229 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=69d3abde19806e9569c0608ba8dda407, UNASSIGN in 276 msec 2023-07-17 12:12:17,231 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed fc67215270264d93b1baf010dd738f44 2023-07-17 12:12:17,239 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=fc67215270264d93b1baf010dd738f44, regionState=CLOSED 2023-07-17 12:12:17,239 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689595904366.fc67215270264d93b1baf010dd738f44.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689595937239"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595937239"}]},"ts":"1689595937239"} 2023-07-17 12:12:17,244 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-17 12:12:17,244 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure fc67215270264d93b1baf010dd738f44, server=jenkins-hbase4.apache.org,37767,1689595859826 in 286 msec 2023-07-17 12:12:17,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-17 12:12:17,246 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-17 12:12:17,247 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=fc67215270264d93b1baf010dd738f44, UNASSIGN in 297 msec 2023-07-17 12:12:17,247 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595937247"}]},"ts":"1689595937247"} 2023-07-17 12:12:17,249 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-17 12:12:17,252 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-17 12:12:17,256 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 322 msec 2023-07-17 12:12:17,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-17 12:12:17,546 INFO [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-17 12:12:17,547 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-17 12:12:17,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-17 12:12:17,552 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-17 12:12:17,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-17 12:12:17,554 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-17 12:12:17,560 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44163] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-17 12:12:17,564 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 12:12:17,564 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 12:12:17,564 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 12:12:17,565 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-17 12:12:17,565 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-17 12:12:17,565 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-17 12:12:17,567 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testConsecutiveExports/69d3abde19806e9569c0608ba8dda407 2023-07-17 12:12:17,570 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testConsecutiveExports/69d3abde19806e9569c0608ba8dda407/cf, FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testConsecutiveExports/69d3abde19806e9569c0608ba8dda407/recovered.edits] 2023-07-17 12:12:17,570 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 12:12:17,572 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:17,572 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 12:12:17,572 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 12:12:17,572 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-07-17 12:12:17,573 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:17,573 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-17 12:12:17,572 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:17,573 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 12:12:17,573 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:17,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-17 12:12:17,588 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testConsecutiveExports/fc67215270264d93b1baf010dd738f44 2023-07-17 12:12:17,592 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testConsecutiveExports/fc67215270264d93b1baf010dd738f44/cf, FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testConsecutiveExports/fc67215270264d93b1baf010dd738f44/recovered.edits] 2023-07-17 12:12:17,593 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testConsecutiveExports/69d3abde19806e9569c0608ba8dda407/cf/83afb7b7239743bcba614900999b9dc4 to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/archive/data/default/testtb-testConsecutiveExports/69d3abde19806e9569c0608ba8dda407/cf/83afb7b7239743bcba614900999b9dc4 2023-07-17 12:12:17,597 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testConsecutiveExports/69d3abde19806e9569c0608ba8dda407/recovered.edits/9.seqid to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/archive/data/default/testtb-testConsecutiveExports/69d3abde19806e9569c0608ba8dda407/recovered.edits/9.seqid 2023-07-17 12:12:17,597 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testConsecutiveExports/69d3abde19806e9569c0608ba8dda407 2023-07-17 12:12:17,598 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testConsecutiveExports/fc67215270264d93b1baf010dd738f44/cf/afa4e8f19cfa409090d238deaee2e0ea to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/archive/data/default/testtb-testConsecutiveExports/fc67215270264d93b1baf010dd738f44/cf/afa4e8f19cfa409090d238deaee2e0ea 2023-07-17 12:12:17,602 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testConsecutiveExports/fc67215270264d93b1baf010dd738f44/recovered.edits/9.seqid to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/archive/data/default/testtb-testConsecutiveExports/fc67215270264d93b1baf010dd738f44/recovered.edits/9.seqid 2023-07-17 12:12:17,602 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testConsecutiveExports/fc67215270264d93b1baf010dd738f44 2023-07-17 12:12:17,602 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-17 12:12:17,605 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-17 12:12:17,613 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-17 12:12:17,621 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-17 12:12:17,622 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-17 12:12:17,623 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-17 12:12:17,623 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689595904366.69d3abde19806e9569c0608ba8dda407.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689595937623"}]},"ts":"9223372036854775807"} 2023-07-17 12:12:17,623 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689595904366.fc67215270264d93b1baf010dd738f44.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689595937623"}]},"ts":"9223372036854775807"} 2023-07-17 12:12:17,625 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-17 12:12:17,625 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 69d3abde19806e9569c0608ba8dda407, NAME => 'testtb-testConsecutiveExports,,1689595904366.69d3abde19806e9569c0608ba8dda407.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => fc67215270264d93b1baf010dd738f44, NAME => 'testtb-testConsecutiveExports,1,1689595904366.fc67215270264d93b1baf010dd738f44.', STARTKEY => '1', ENDKEY => ''}] 2023-07-17 12:12:17,625 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-17 12:12:17,625 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689595937625"}]},"ts":"9223372036854775807"} 2023-07-17 12:12:17,628 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-17 12:12:17,633 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-17 12:12:17,634 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 85 msec 2023-07-17 12:12:17,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-17 12:12:17,675 INFO [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-17 12:12:17,706 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-17 12:12:17,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-17 12:12:17,712 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-17 12:12:17,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-17 12:12:17,745 INFO [Listener at jenkins-hbase4.apache.org/42275] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=746 (was 762), OpenFileDescriptor=892 (was 923), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=469 (was 483), ProcessCount=183 (was 181) - ProcessCount LEAK? -, AvailableMemoryMB=2583 (was 3050) 2023-07-17 12:12:17,746 WARN [Listener at jenkins-hbase4.apache.org/42275] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-07-17 12:12:17,775 INFO [Listener at jenkins-hbase4.apache.org/42275] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=746, OpenFileDescriptor=892, MaxFileDescriptor=60000, SystemLoadAverage=469, ProcessCount=183, AvailableMemoryMB=2579 2023-07-17 12:12:17,775 WARN [Listener at jenkins-hbase4.apache.org/42275] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-07-17 12:12:17,777 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-17 12:12:17,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:17,782 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 12:12:17,782 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-17 12:12:17,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-17 12:12:17,784 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 12:12:17,788 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b469747bd2677ee324c2aa0a8b29f81 2023-07-17 12:12:17,790 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/56130c84af27d11011d1035a53f12b8d 2023-07-17 12:12:17,792 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/56130c84af27d11011d1035a53f12b8d empty. 2023-07-17 12:12:17,792 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b469747bd2677ee324c2aa0a8b29f81 empty. 2023-07-17 12:12:17,793 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/56130c84af27d11011d1035a53f12b8d 2023-07-17 12:12:17,793 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b469747bd2677ee324c2aa0a8b29f81 2023-07-17 12:12:17,793 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-17 12:12:17,841 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-17 12:12:17,842 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0b469747bd2677ee324c2aa0a8b29f81, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689595937777.0b469747bd2677ee324c2aa0a8b29f81.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp 2023-07-17 12:12:17,843 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 56130c84af27d11011d1035a53f12b8d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689595937777.56130c84af27d11011d1035a53f12b8d.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp 2023-07-17 12:12:17,884 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689595937777.0b469747bd2677ee324c2aa0a8b29f81.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:12:17,884 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 0b469747bd2677ee324c2aa0a8b29f81, disabling compactions & flushes 2023-07-17 12:12:17,884 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689595937777.0b469747bd2677ee324c2aa0a8b29f81. 2023-07-17 12:12:17,884 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689595937777.0b469747bd2677ee324c2aa0a8b29f81. 2023-07-17 12:12:17,884 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689595937777.0b469747bd2677ee324c2aa0a8b29f81. after waiting 0 ms 2023-07-17 12:12:17,884 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689595937777.0b469747bd2677ee324c2aa0a8b29f81. 2023-07-17 12:12:17,884 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689595937777.0b469747bd2677ee324c2aa0a8b29f81. 2023-07-17 12:12:17,884 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 0b469747bd2677ee324c2aa0a8b29f81: 2023-07-17 12:12:17,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-17 12:12:18,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-17 12:12:18,284 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689595937777.56130c84af27d11011d1035a53f12b8d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:12:18,284 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 56130c84af27d11011d1035a53f12b8d, disabling compactions & flushes 2023-07-17 12:12:18,284 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689595937777.56130c84af27d11011d1035a53f12b8d. 2023-07-17 12:12:18,284 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689595937777.56130c84af27d11011d1035a53f12b8d. 2023-07-17 12:12:18,284 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689595937777.56130c84af27d11011d1035a53f12b8d. after waiting 0 ms 2023-07-17 12:12:18,284 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689595937777.56130c84af27d11011d1035a53f12b8d. 2023-07-17 12:12:18,284 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689595937777.56130c84af27d11011d1035a53f12b8d. 2023-07-17 12:12:18,284 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 56130c84af27d11011d1035a53f12b8d: 2023-07-17 12:12:18,291 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 12:12:18,292 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689595937777.0b469747bd2677ee324c2aa0a8b29f81.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689595938292"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595938292"}]},"ts":"1689595938292"} 2023-07-17 12:12:18,293 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689595937777.56130c84af27d11011d1035a53f12b8d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689595938292"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595938292"}]},"ts":"1689595938292"} 2023-07-17 12:12:18,300 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-17 12:12:18,301 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 12:12:18,302 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595938302"}]},"ts":"1689595938302"} 2023-07-17 12:12:18,303 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-17 12:12:18,307 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 12:12:18,308 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 12:12:18,308 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 12:12:18,308 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 12:12:18,308 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 12:12:18,309 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0b469747bd2677ee324c2aa0a8b29f81, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=56130c84af27d11011d1035a53f12b8d, ASSIGN}] 2023-07-17 12:12:18,311 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=56130c84af27d11011d1035a53f12b8d, ASSIGN 2023-07-17 12:12:18,312 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0b469747bd2677ee324c2aa0a8b29f81, ASSIGN 2023-07-17 12:12:18,313 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=56130c84af27d11011d1035a53f12b8d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34107,1689595859757; forceNewPlan=false, retain=false 2023-07-17 12:12:18,313 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0b469747bd2677ee324c2aa0a8b29f81, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44163,1689595859880; forceNewPlan=false, retain=false 2023-07-17 12:12:18,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-17 12:12:18,463 INFO [jenkins-hbase4:35573] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-17 12:12:18,466 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=0b469747bd2677ee324c2aa0a8b29f81, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:18,466 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=56130c84af27d11011d1035a53f12b8d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:18,466 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689595937777.0b469747bd2677ee324c2aa0a8b29f81.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689595938466"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595938466"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595938466"}]},"ts":"1689595938466"} 2023-07-17 12:12:18,466 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689595937777.56130c84af27d11011d1035a53f12b8d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689595938466"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595938466"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595938466"}]},"ts":"1689595938466"} 2023-07-17 12:12:18,468 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure 0b469747bd2677ee324c2aa0a8b29f81, server=jenkins-hbase4.apache.org,44163,1689595859880}] 2023-07-17 12:12:18,470 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 56130c84af27d11011d1035a53f12b8d, server=jenkins-hbase4.apache.org,34107,1689595859757}] 2023-07-17 12:12:18,627 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689595937777.56130c84af27d11011d1035a53f12b8d. 2023-07-17 12:12:18,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 56130c84af27d11011d1035a53f12b8d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689595937777.56130c84af27d11011d1035a53f12b8d.', STARTKEY => '1', ENDKEY => ''} 2023-07-17 12:12:18,628 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689595937777.0b469747bd2677ee324c2aa0a8b29f81. 2023-07-17 12:12:18,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0b469747bd2677ee324c2aa0a8b29f81, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689595937777.0b469747bd2677ee324c2aa0a8b29f81.', STARTKEY => '', ENDKEY => '1'} 2023-07-17 12:12:18,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689595937777.0b469747bd2677ee324c2aa0a8b29f81. service=AccessControlService 2023-07-17 12:12:18,628 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 12:12:18,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 0b469747bd2677ee324c2aa0a8b29f81 2023-07-17 12:12:18,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689595937777.0b469747bd2677ee324c2aa0a8b29f81.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:12:18,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0b469747bd2677ee324c2aa0a8b29f81 2023-07-17 12:12:18,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0b469747bd2677ee324c2aa0a8b29f81 2023-07-17 12:12:18,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689595937777.56130c84af27d11011d1035a53f12b8d. service=AccessControlService 2023-07-17 12:12:18,629 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 12:12:18,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 56130c84af27d11011d1035a53f12b8d 2023-07-17 12:12:18,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689595937777.56130c84af27d11011d1035a53f12b8d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:12:18,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 56130c84af27d11011d1035a53f12b8d 2023-07-17 12:12:18,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 56130c84af27d11011d1035a53f12b8d 2023-07-17 12:12:18,631 INFO [StoreOpener-56130c84af27d11011d1035a53f12b8d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 56130c84af27d11011d1035a53f12b8d 2023-07-17 12:12:18,631 INFO [StoreOpener-0b469747bd2677ee324c2aa0a8b29f81-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0b469747bd2677ee324c2aa0a8b29f81 2023-07-17 12:12:18,633 DEBUG [StoreOpener-56130c84af27d11011d1035a53f12b8d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion/56130c84af27d11011d1035a53f12b8d/cf 2023-07-17 12:12:18,633 DEBUG [StoreOpener-56130c84af27d11011d1035a53f12b8d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion/56130c84af27d11011d1035a53f12b8d/cf 2023-07-17 12:12:18,633 DEBUG [StoreOpener-0b469747bd2677ee324c2aa0a8b29f81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b469747bd2677ee324c2aa0a8b29f81/cf 2023-07-17 12:12:18,633 DEBUG [StoreOpener-0b469747bd2677ee324c2aa0a8b29f81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b469747bd2677ee324c2aa0a8b29f81/cf 2023-07-17 12:12:18,635 INFO [StoreOpener-56130c84af27d11011d1035a53f12b8d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 56130c84af27d11011d1035a53f12b8d columnFamilyName cf 2023-07-17 12:12:18,635 INFO [StoreOpener-0b469747bd2677ee324c2aa0a8b29f81-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0b469747bd2677ee324c2aa0a8b29f81 columnFamilyName cf 2023-07-17 12:12:18,636 INFO [StoreOpener-0b469747bd2677ee324c2aa0a8b29f81-1] regionserver.HStore(310): Store=0b469747bd2677ee324c2aa0a8b29f81/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 12:12:18,636 INFO [StoreOpener-56130c84af27d11011d1035a53f12b8d-1] regionserver.HStore(310): Store=56130c84af27d11011d1035a53f12b8d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 12:12:18,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion/56130c84af27d11011d1035a53f12b8d 2023-07-17 12:12:18,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b469747bd2677ee324c2aa0a8b29f81 2023-07-17 12:12:18,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b469747bd2677ee324c2aa0a8b29f81 2023-07-17 12:12:18,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion/56130c84af27d11011d1035a53f12b8d 2023-07-17 12:12:18,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0b469747bd2677ee324c2aa0a8b29f81 2023-07-17 12:12:18,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 56130c84af27d11011d1035a53f12b8d 2023-07-17 12:12:18,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b469747bd2677ee324c2aa0a8b29f81/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 12:12:18,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion/56130c84af27d11011d1035a53f12b8d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 12:12:18,648 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0b469747bd2677ee324c2aa0a8b29f81; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61493769, jitterRate=-0.083671435713768}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 12:12:18,648 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 56130c84af27d11011d1035a53f12b8d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71081871, jitterRate=0.059202417731285095}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 12:12:18,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0b469747bd2677ee324c2aa0a8b29f81: 2023-07-17 12:12:18,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 56130c84af27d11011d1035a53f12b8d: 2023-07-17 12:12:18,649 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689595937777.56130c84af27d11011d1035a53f12b8d., pid=61, masterSystemTime=1689595938623 2023-07-17 12:12:18,649 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689595937777.0b469747bd2677ee324c2aa0a8b29f81., pid=60, masterSystemTime=1689595938620 2023-07-17 12:12:18,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689595937777.0b469747bd2677ee324c2aa0a8b29f81. 2023-07-17 12:12:18,651 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689595937777.0b469747bd2677ee324c2aa0a8b29f81. 2023-07-17 12:12:18,651 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=0b469747bd2677ee324c2aa0a8b29f81, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:18,652 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689595937777.0b469747bd2677ee324c2aa0a8b29f81.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689595938651"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689595938651"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689595938651"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689595938651"}]},"ts":"1689595938651"} 2023-07-17 12:12:18,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689595937777.56130c84af27d11011d1035a53f12b8d. 2023-07-17 12:12:18,652 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689595937777.56130c84af27d11011d1035a53f12b8d. 2023-07-17 12:12:18,652 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=56130c84af27d11011d1035a53f12b8d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:18,652 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689595937777.56130c84af27d11011d1035a53f12b8d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689595938652"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689595938652"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689595938652"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689595938652"}]},"ts":"1689595938652"} 2023-07-17 12:12:18,662 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-17 12:12:18,662 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure 0b469747bd2677ee324c2aa0a8b29f81, server=jenkins-hbase4.apache.org,44163,1689595859880 in 186 msec 2023-07-17 12:12:18,668 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-17 12:12:18,668 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 56130c84af27d11011d1035a53f12b8d, server=jenkins-hbase4.apache.org,34107,1689595859757 in 189 msec 2023-07-17 12:12:18,669 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0b469747bd2677ee324c2aa0a8b29f81, ASSIGN in 358 msec 2023-07-17 12:12:18,673 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-17 12:12:18,673 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=56130c84af27d11011d1035a53f12b8d, ASSIGN in 359 msec 2023-07-17 12:12:18,674 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 12:12:18,674 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595938674"}]},"ts":"1689595938674"} 2023-07-17 12:12:18,675 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-17 12:12:18,679 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 12:12:18,679 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-17 12:12:18,684 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44163] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-17 12:12:18,685 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:18,685 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:18,685 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:18,686 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:18,691 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 12:12:18,691 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 12:12:18,692 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 12:12:18,692 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 12:12:18,693 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 914 msec 2023-07-17 12:12:18,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-17 12:12:18,889 INFO [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-17 12:12:18,890 DEBUG [Listener at jenkins-hbase4.apache.org/42275] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-17 12:12:18,890 INFO [Listener at jenkins-hbase4.apache.org/42275] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 12:12:18,893 INFO [Listener at jenkins-hbase4.apache.org/42275] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-17 12:12:18,893 INFO [Listener at jenkins-hbase4.apache.org/42275] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 12:12:18,893 INFO [Listener at jenkins-hbase4.apache.org/42275] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-17 12:12:18,897 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-17 12:12:18,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689595938897 (current time:1689595938897). 2023-07-17 12:12:18,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 12:12:18,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(139): Connect 0x034d2a03 to 127.0.0.1:60075 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:12:18,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@748b85bd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:12:18,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:12:18,909 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46062, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:12:18,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x034d2a03 to 127.0.0.1:60075 2023-07-17 12:12:18,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:12:18,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(139): Connect 0x10053067 to 127.0.0.1:60075 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:12:18,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7af20d56, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:12:18,920 DEBUG [hconnection-0x52fcc9d8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:12:18,921 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46066, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:12:18,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:12:18,928 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56330, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:12:18,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x10053067 to 127.0.0.1:60075 2023-07-17 12:12:18,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:12:18,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-17 12:12:18,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 12:12:18,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-17 12:12:18,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-17 12:12:18,935 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-17 12:12:18,936 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689596538936 2023-07-17 12:12:18,936 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:18,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-17 12:12:18,939 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-17 12:12:18,939 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-17 12:12:18,939 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 12:12:18,940 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 12:12:18,941 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-17 12:12:18,942 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-17 12:12:18,942 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689596538942 2023-07-17 12:12:18,978 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:18,979 INFO [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-17 12:12:18,979 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:18,980 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-17 12:12:18,980 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-17 12:12:19,037 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,037 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,039 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:19,039 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:19,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:19,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:19,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:19,039 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:19,039 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:19,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:19,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:19,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:19,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,040 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:12:19,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,040 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,040 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:19,040 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:19,040 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,040 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,041 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:19,041 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 12:12:19,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-17 12:12:19,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-17 12:12:19,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:12:19,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,041 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-17 12:12:19,041 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 12:12:19,042 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-17 12:12:19,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-17 12:12:19,042 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-17 12:12:19,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,043 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:19,043 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-17 12:12:19,044 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-17 12:12:19,044 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-17 12:12:19,044 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-17 12:12:19,044 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37767,1689595859826' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-17 12:12:19,044 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,045 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,045 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-17 12:12:19,045 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-17 12:12:19,045 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:19,045 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:19,046 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-17 12:12:19,048 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-17 12:12:19,048 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-17 12:12:19,048 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-17 12:12:19,048 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34107,1689595859757' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-17 12:12:19,048 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44163,1689595859880' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-17 12:12:19,049 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,050 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,050 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:19,050 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,050 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:19,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:19,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:19,050 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,050 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:12:19,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:19,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:19,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:19,050 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:19,050 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,052 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:12:19,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:19,050 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:12:19,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:19,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:19,053 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44163,1689595859880' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-17 12:12:19,053 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@101a5071[Count = 1] remaining members to acquire global barrier 2023-07-17 12:12:19,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:19,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:19,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:19,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:19,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:19,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:19,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:19,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:19,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:19,055 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34107,1689595859757' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-17 12:12:19,055 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@101a5071[Count = 0] remaining members to acquire global barrier 2023-07-17 12:12:19,055 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-17 12:12:19,055 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,058 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,058 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,058 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,058 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-17 12:12:19,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,058 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:19,058 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:12:19,058 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:12:19,058 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-17 12:12:19,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,058 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-17 12:12:19,058 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-17 12:12:19,058 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689595937777.56130c84af27d11011d1035a53f12b8d. 2023-07-17 12:12:19,059 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:19,059 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689595937777.56130c84af27d11011d1035a53f12b8d. started... 2023-07-17 12:12:19,059 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:12:19,059 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:12:19,059 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37767,1689595859826' in zk 2023-07-17 12:12:19,060 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 56130c84af27d11011d1035a53f12b8d: 2023-07-17 12:12:19,059 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689595937777.0b469747bd2677ee324c2aa0a8b29f81. 2023-07-17 12:12:19,059 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 12:12:19,060 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689595937777.0b469747bd2677ee324c2aa0a8b29f81. started... 2023-07-17 12:12:19,060 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689595937777.56130c84af27d11011d1035a53f12b8d.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,060 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:12:19,060 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 12:12:19,061 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0b469747bd2677ee324c2aa0a8b29f81: 2023-07-17 12:12:19,062 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689595937777.0b469747bd2677ee324c2aa0a8b29f81.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,062 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:12:19,062 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 12:12:19,070 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-17 12:12:19,070 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:19,070 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-17 12:12:19,107 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689595937777.56130c84af27d11011d1035a53f12b8d. completed. 2023-07-17 12:12:19,107 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689595937777.56130c84af27d11011d1035a53f12b8d. 2023-07-17 12:12:19,107 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:12:19,107 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:12:19,107 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:19,110 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-17 12:12:19,111 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34107,1689595859757' in zk 2023-07-17 12:12:19,113 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:19,113 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-17 12:12:19,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:19,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:19,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:19,113 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:19,113 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-17 12:12:19,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:19,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:19,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:19,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:19,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:19,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:19,123 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689595937777.0b469747bd2677ee324c2aa0a8b29f81. completed. 2023-07-17 12:12:19,123 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689595937777.0b469747bd2677ee324c2aa0a8b29f81. 2023-07-17 12:12:19,123 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:12:19,123 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:12:19,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,123 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:19,123 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-17 12:12:19,123 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44163,1689595859880' in zk 2023-07-17 12:12:19,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:19,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:19,125 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-17 12:12:19,125 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:19,125 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-17 12:12:19,127 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:19,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,34107,1689595859757': 2023-07-17 12:12:19,128 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34107,1689595859757' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-17 12:12:19,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:19,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:19,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:19,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:19,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:19,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:19,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:19,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:19,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:19,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:19,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:19,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:19,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,44163,1689595859880': 2023-07-17 12:12:19,133 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44163,1689595859880' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-17 12:12:19,133 INFO [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-17 12:12:19,133 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 12:12:19,133 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 12:12:19,133 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,133 INFO [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 12:12:19,135 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,135 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,135 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,135 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:19,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:19,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:19,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,135 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:19,136 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:19,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:19,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:19,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:19,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:19,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:19,136 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:19,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,137 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:19,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:19,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,137 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,138 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:19,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:19,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:19,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:19,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:19,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:19,140 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:19,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:19,140 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:19,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,141 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:19,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:19,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:19,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:19,147 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:19,147 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:19,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:19,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:19,147 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:19,147 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:19,147 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,147 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:19,147 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:19,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:19,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:19,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:19,149 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:19,149 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:19,147 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:19,147 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,150 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:19,150 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,150 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,150 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:19,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:19,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:19,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:19,150 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,150 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:19,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:19,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:19,150 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:19,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:19,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:19,150 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,150 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,151 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,176 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,226 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-17 12:12:19,226 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,227 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,227 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689595938936Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689595939150 (+214 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689595939150Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689595939158 (+8 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689595939170 (+12 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689595939226 (+56 ms) 2023-07-17 12:12:19,230 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-17 12:12:19,232 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 293 msec 2023-07-17 12:12:19,242 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:12:19,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-17 12:12:19,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 12:12:19,252 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44163] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689595937777.0b469747bd2677ee324c2aa0a8b29f81. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 12:12:19,253 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34107] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689595937777.56130c84af27d11011d1035a53f12b8d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 12:12:19,257 DEBUG [Listener at jenkins-hbase4.apache.org/42275] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,257 DEBUG [Listener at jenkins-hbase4.apache.org/42275] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689595937777.0b469747bd2677ee324c2aa0a8b29f81. 2023-07-17 12:12:19,257 INFO [Listener at jenkins-hbase4.apache.org/42275] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 12:12:19,283 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-17 12:12:19,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689595939283 (current time:1689595939283). 2023-07-17 12:12:19,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 12:12:19,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(139): Connect 0x1c89b7ea to 127.0.0.1:60075 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:12:19,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7209279f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:12:19,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:12:19,305 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46070, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:12:19,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c89b7ea to 127.0.0.1:60075 2023-07-17 12:12:19,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:12:19,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(139): Connect 0x09eda058 to 127.0.0.1:60075 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:12:19,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@588a7068, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:12:19,327 DEBUG [hconnection-0x63849139-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:12:19,331 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46074, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:12:19,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:12:19,338 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56332, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:12:19,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x09eda058 to 127.0.0.1:60075 2023-07-17 12:12:19,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:12:19,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-17 12:12:19,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 12:12:19,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-17 12:12:19,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-17 12:12:19,344 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-17 12:12:19,345 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689596539345 2023-07-17 12:12:19,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-17 12:12:19,345 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,346 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 12:12:19,346 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 12:12:19,347 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-17 12:12:19,348 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-17 12:12:19,349 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-17 12:12:19,350 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-17 12:12:19,351 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689596539351 2023-07-17 12:12:19,372 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,372 INFO [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-17 12:12:19,372 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:19,374 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-17 12:12:19,374 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-17 12:12:19,374 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,374 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,375 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:19,375 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:19,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:19,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:19,375 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:19,376 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:19,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:19,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:19,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:19,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:19,376 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:19,376 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:19,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,376 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,377 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,377 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:19,377 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 12:12:19,377 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-17 12:12:19,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-17 12:12:19,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,377 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-17 12:12:19,377 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-17 12:12:19,378 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,378 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-17 12:12:19,378 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:19,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-17 12:12:19,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,378 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,380 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-17 12:12:19,380 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-17 12:12:19,380 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-17 12:12:19,380 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37767,1689595859826' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-17 12:12:19,380 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-17 12:12:19,381 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:19,382 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,384 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-17 12:12:19,384 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-17 12:12:19,384 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-17 12:12:19,384 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34107,1689595859757' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-17 12:12:19,384 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:19,386 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-17 12:12:19,386 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-17 12:12:19,386 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44163,1689595859880' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-17 12:12:19,387 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,388 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,388 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,388 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:19,388 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:12:19,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:19,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:19,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:19,388 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:19,388 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,388 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:12:19,389 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:19,389 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,389 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:12:19,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:19,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:19,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:19,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:19,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:19,391 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34107,1689595859757' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-17 12:12:19,391 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70abcc5e[Count = 1] remaining members to acquire global barrier 2023-07-17 12:12:19,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:19,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:19,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:19,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:19,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:19,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:19,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:19,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:19,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:19,394 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44163,1689595859880' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-17 12:12:19,394 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70abcc5e[Count = 0] remaining members to acquire global barrier 2023-07-17 12:12:19,394 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-17 12:12:19,395 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,397 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,397 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,397 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,397 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:19,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,397 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:19,398 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 12:12:19,397 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-17 12:12:19,397 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-17 12:12:19,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,398 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:12:19,398 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-17 12:12:19,398 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689595937777.56130c84af27d11011d1035a53f12b8d. 2023-07-17 12:12:19,398 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:12:19,398 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689595937777.56130c84af27d11011d1035a53f12b8d. started... 2023-07-17 12:12:19,398 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-17 12:12:19,399 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37767,1689595859826' in zk 2023-07-17 12:12:19,399 INFO [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 56130c84af27d11011d1035a53f12b8d 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-17 12:12:19,400 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-17 12:12:19,400 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:19,400 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-17 12:12:19,403 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:12:19,403 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:12:19,405 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689595937777.0b469747bd2677ee324c2aa0a8b29f81. 2023-07-17 12:12:19,405 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689595937777.0b469747bd2677ee324c2aa0a8b29f81. started... 2023-07-17 12:12:19,405 INFO [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0b469747bd2677ee324c2aa0a8b29f81 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-17 12:12:19,431 INFO [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b469747bd2677ee324c2aa0a8b29f81/.tmp/cf/ac732fbffba24d1a88b53c44703d8809 2023-07-17 12:12:19,434 INFO [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion/56130c84af27d11011d1035a53f12b8d/.tmp/cf/44abed0e450146c2acca8f848de9d238 2023-07-17 12:12:19,465 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:12:19,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-17 12:12:19,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:12:19,471 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 12:12:19,474 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion/56130c84af27d11011d1035a53f12b8d/.tmp/cf/44abed0e450146c2acca8f848de9d238 as hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion/56130c84af27d11011d1035a53f12b8d/cf/44abed0e450146c2acca8f848de9d238 2023-07-17 12:12:19,476 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b469747bd2677ee324c2aa0a8b29f81/.tmp/cf/ac732fbffba24d1a88b53c44703d8809 as hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b469747bd2677ee324c2aa0a8b29f81/cf/ac732fbffba24d1a88b53c44703d8809 2023-07-17 12:12:19,482 INFO [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion/56130c84af27d11011d1035a53f12b8d/cf/44abed0e450146c2acca8f848de9d238, entries=46, sequenceid=6, filesize=7.9 K 2023-07-17 12:12:19,482 INFO [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b469747bd2677ee324c2aa0a8b29f81/cf/ac732fbffba24d1a88b53c44703d8809, entries=4, sequenceid=6, filesize=5.1 K 2023-07-17 12:12:19,483 INFO [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 0b469747bd2677ee324c2aa0a8b29f81 in 78ms, sequenceid=6, compaction requested=false 2023-07-17 12:12:19,483 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-17 12:12:19,483 INFO [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 56130c84af27d11011d1035a53f12b8d in 84ms, sequenceid=6, compaction requested=false 2023-07-17 12:12:19,483 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-17 12:12:19,487 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0b469747bd2677ee324c2aa0a8b29f81: 2023-07-17 12:12:19,487 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 56130c84af27d11011d1035a53f12b8d: 2023-07-17 12:12:19,487 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689595937777.56130c84af27d11011d1035a53f12b8d.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,487 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689595937777.0b469747bd2677ee324c2aa0a8b29f81.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,487 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:12:19,487 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:12:19,487 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion/56130c84af27d11011d1035a53f12b8d/cf/44abed0e450146c2acca8f848de9d238] hfiles 2023-07-17 12:12:19,488 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b469747bd2677ee324c2aa0a8b29f81/cf/ac732fbffba24d1a88b53c44703d8809] hfiles 2023-07-17 12:12:19,488 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b469747bd2677ee324c2aa0a8b29f81/cf/ac732fbffba24d1a88b53c44703d8809 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,488 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion/56130c84af27d11011d1035a53f12b8d/cf/44abed0e450146c2acca8f848de9d238 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,504 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689595937777.0b469747bd2677ee324c2aa0a8b29f81. completed. 2023-07-17 12:12:19,504 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689595937777.0b469747bd2677ee324c2aa0a8b29f81. 2023-07-17 12:12:19,504 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:12:19,504 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:12:19,504 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:19,505 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689595937777.56130c84af27d11011d1035a53f12b8d. completed. 2023-07-17 12:12:19,505 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689595937777.56130c84af27d11011d1035a53f12b8d. 2023-07-17 12:12:19,505 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-17 12:12:19,505 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:12:19,505 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:12:19,505 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44163,1689595859880' in zk 2023-07-17 12:12:19,505 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:19,505 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-17 12:12:19,505 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34107,1689595859757' in zk 2023-07-17 12:12:19,506 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-17 12:12:19,506 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-17 12:12:19,507 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:19,506 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:19,507 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-17 12:12:19,507 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:19,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:19,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:19,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:19,507 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:19,509 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-17 12:12:19,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:19,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:19,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:19,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:19,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:19,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:19,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:19,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:19,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:19,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,44163,1689595859880': 2023-07-17 12:12:19,515 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44163,1689595859880' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-17 12:12:19,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:19,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:19,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:19,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:19,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:19,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:19,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:19,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:19,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:19,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:19,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:19,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:19,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,34107,1689595859757': 2023-07-17 12:12:19,518 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34107,1689595859757' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-17 12:12:19,518 INFO [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-17 12:12:19,518 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 12:12:19,519 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 12:12:19,519 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,519 INFO [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 12:12:19,525 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,525 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,525 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,525 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,525 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:19,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,525 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:19,525 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:19,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:19,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:19,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:19,526 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:19,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:19,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:19,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:19,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:19,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:19,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:19,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,526 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:19,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,527 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:19,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:19,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:19,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:19,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:19,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:19,529 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:19,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,529 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:19,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:19,530 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:19,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:19,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:19,533 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:19,533 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:19,533 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:19,533 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:19,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:19,533 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:19,533 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:19,533 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:19,533 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:19,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:19,533 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:19,533 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:19,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:19,533 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:19,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:19,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:19,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:19,533 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:19,533 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,535 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,535 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:19,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:19,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:19,535 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:19,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:19,536 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:19,536 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:19,536 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,536 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,536 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,559 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,604 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-17 12:12:19,604 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,605 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:19,605 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689595939345Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689595939535 (+190 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689595939535Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689595939539 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689595939552 (+13 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689595939604 (+52 ms) 2023-07-17 12:12:19,607 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-17 12:12:19,609 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 261 msec 2023-07-17 12:12:19,672 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:12:19,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-17 12:12:19,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 12:12:19,710 DEBUG [Listener at jenkins-hbase4.apache.org/42275] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-17 12:12:19,714 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46080, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-17 12:12:19,715 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34107] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-17 12:12:19,716 DEBUG [Listener at jenkins-hbase4.apache.org/42275] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-17 12:12:19,722 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55438, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-17 12:12:19,722 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37767] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-17 12:12:19,722 DEBUG [Listener at jenkins-hbase4.apache.org/42275] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-17 12:12:19,727 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56342, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-17 12:12:19,727 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44163] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-17 12:12:19,731 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-17 12:12:19,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:19,737 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 12:12:19,738 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-17 12:12:19,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-17 12:12:19,740 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 12:12:19,744 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ace9688399131e6f847023dee0e5e6c4 2023-07-17 12:12:19,744 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/07b1a9065c88729a23ffe1e591a0a646 2023-07-17 12:12:19,744 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ace9688399131e6f847023dee0e5e6c4 empty. 2023-07-17 12:12:19,745 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/07b1a9065c88729a23ffe1e591a0a646 empty. 2023-07-17 12:12:19,745 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ace9688399131e6f847023dee0e5e6c4 2023-07-17 12:12:19,745 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/07b1a9065c88729a23ffe1e591a0a646 2023-07-17 12:12:19,745 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-17 12:12:19,777 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-17 12:12:19,779 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => ace9688399131e6f847023dee0e5e6c4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939731.ace9688399131e6f847023dee0e5e6c4.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp 2023-07-17 12:12:19,784 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 07b1a9065c88729a23ffe1e591a0a646, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595939731.07b1a9065c88729a23ffe1e591a0a646.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp 2023-07-17 12:12:19,819 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595939731.07b1a9065c88729a23ffe1e591a0a646.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:12:19,819 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939731.ace9688399131e6f847023dee0e5e6c4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:12:19,819 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 07b1a9065c88729a23ffe1e591a0a646, disabling compactions & flushes 2023-07-17 12:12:19,819 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing ace9688399131e6f847023dee0e5e6c4, disabling compactions & flushes 2023-07-17 12:12:19,819 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595939731.07b1a9065c88729a23ffe1e591a0a646. 2023-07-17 12:12:19,819 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595939731.07b1a9065c88729a23ffe1e591a0a646. 2023-07-17 12:12:19,819 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939731.ace9688399131e6f847023dee0e5e6c4. 2023-07-17 12:12:19,819 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595939731.07b1a9065c88729a23ffe1e591a0a646. after waiting 0 ms 2023-07-17 12:12:19,819 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939731.ace9688399131e6f847023dee0e5e6c4. 2023-07-17 12:12:19,819 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595939731.07b1a9065c88729a23ffe1e591a0a646. 2023-07-17 12:12:19,819 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939731.ace9688399131e6f847023dee0e5e6c4. after waiting 0 ms 2023-07-17 12:12:19,820 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939731.ace9688399131e6f847023dee0e5e6c4. 2023-07-17 12:12:19,819 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595939731.07b1a9065c88729a23ffe1e591a0a646. 2023-07-17 12:12:19,820 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939731.ace9688399131e6f847023dee0e5e6c4. 2023-07-17 12:12:19,820 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 07b1a9065c88729a23ffe1e591a0a646: 2023-07-17 12:12:19,820 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for ace9688399131e6f847023dee0e5e6c4: 2023-07-17 12:12:19,823 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 12:12:19,824 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595939731.07b1a9065c88729a23ffe1e591a0a646.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689595939823"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595939823"}]},"ts":"1689595939823"} 2023-07-17 12:12:19,824 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939731.ace9688399131e6f847023dee0e5e6c4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689595939823"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595939823"}]},"ts":"1689595939823"} 2023-07-17 12:12:19,826 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-17 12:12:19,830 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 12:12:19,830 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595939830"}]},"ts":"1689595939830"} 2023-07-17 12:12:19,832 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-17 12:12:19,835 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 12:12:19,837 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 12:12:19,837 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 12:12:19,837 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 12:12:19,837 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 12:12:19,837 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ace9688399131e6f847023dee0e5e6c4, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=07b1a9065c88729a23ffe1e591a0a646, ASSIGN}] 2023-07-17 12:12:19,840 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=07b1a9065c88729a23ffe1e591a0a646, ASSIGN 2023-07-17 12:12:19,840 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ace9688399131e6f847023dee0e5e6c4, ASSIGN 2023-07-17 12:12:19,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-17 12:12:19,842 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=07b1a9065c88729a23ffe1e591a0a646, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44163,1689595859880; forceNewPlan=false, retain=false 2023-07-17 12:12:19,844 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ace9688399131e6f847023dee0e5e6c4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34107,1689595859757; forceNewPlan=false, retain=false 2023-07-17 12:12:19,992 INFO [jenkins-hbase4:35573] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-17 12:12:19,996 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=ace9688399131e6f847023dee0e5e6c4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:19,996 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=07b1a9065c88729a23ffe1e591a0a646, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:19,997 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939731.ace9688399131e6f847023dee0e5e6c4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689595939996"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595939996"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595939996"}]},"ts":"1689595939996"} 2023-07-17 12:12:19,997 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595939731.07b1a9065c88729a23ffe1e591a0a646.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689595939996"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595939996"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595939996"}]},"ts":"1689595939996"} 2023-07-17 12:12:19,999 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure ace9688399131e6f847023dee0e5e6c4, server=jenkins-hbase4.apache.org,34107,1689595859757}] 2023-07-17 12:12:20,001 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 07b1a9065c88729a23ffe1e591a0a646, server=jenkins-hbase4.apache.org,44163,1689595859880}] 2023-07-17 12:12:20,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-17 12:12:20,156 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939731.ace9688399131e6f847023dee0e5e6c4. 2023-07-17 12:12:20,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ace9688399131e6f847023dee0e5e6c4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939731.ace9688399131e6f847023dee0e5e6c4.', STARTKEY => '', ENDKEY => '2'} 2023-07-17 12:12:20,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939731.ace9688399131e6f847023dee0e5e6c4. service=AccessControlService 2023-07-17 12:12:20,157 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 12:12:20,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 ace9688399131e6f847023dee0e5e6c4 2023-07-17 12:12:20,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939731.ace9688399131e6f847023dee0e5e6c4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:12:20,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ace9688399131e6f847023dee0e5e6c4 2023-07-17 12:12:20,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ace9688399131e6f847023dee0e5e6c4 2023-07-17 12:12:20,170 INFO [StoreOpener-ace9688399131e6f847023dee0e5e6c4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ace9688399131e6f847023dee0e5e6c4 2023-07-17 12:12:20,170 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595939731.07b1a9065c88729a23ffe1e591a0a646. 2023-07-17 12:12:20,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 07b1a9065c88729a23ffe1e591a0a646, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595939731.07b1a9065c88729a23ffe1e591a0a646.', STARTKEY => '2', ENDKEY => ''} 2023-07-17 12:12:20,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595939731.07b1a9065c88729a23ffe1e591a0a646. service=AccessControlService 2023-07-17 12:12:20,171 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 12:12:20,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 07b1a9065c88729a23ffe1e591a0a646 2023-07-17 12:12:20,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595939731.07b1a9065c88729a23ffe1e591a0a646.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:12:20,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 07b1a9065c88729a23ffe1e591a0a646 2023-07-17 12:12:20,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 07b1a9065c88729a23ffe1e591a0a646 2023-07-17 12:12:20,173 DEBUG [StoreOpener-ace9688399131e6f847023dee0e5e6c4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ace9688399131e6f847023dee0e5e6c4/cf 2023-07-17 12:12:20,173 DEBUG [StoreOpener-ace9688399131e6f847023dee0e5e6c4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ace9688399131e6f847023dee0e5e6c4/cf 2023-07-17 12:12:20,174 INFO [StoreOpener-ace9688399131e6f847023dee0e5e6c4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ace9688399131e6f847023dee0e5e6c4 columnFamilyName cf 2023-07-17 12:12:20,174 INFO [StoreOpener-ace9688399131e6f847023dee0e5e6c4-1] regionserver.HStore(310): Store=ace9688399131e6f847023dee0e5e6c4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 12:12:20,175 INFO [StoreOpener-07b1a9065c88729a23ffe1e591a0a646-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 07b1a9065c88729a23ffe1e591a0a646 2023-07-17 12:12:20,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ace9688399131e6f847023dee0e5e6c4 2023-07-17 12:12:20,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ace9688399131e6f847023dee0e5e6c4 2023-07-17 12:12:20,179 DEBUG [StoreOpener-07b1a9065c88729a23ffe1e591a0a646-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/07b1a9065c88729a23ffe1e591a0a646/cf 2023-07-17 12:12:20,179 DEBUG [StoreOpener-07b1a9065c88729a23ffe1e591a0a646-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/07b1a9065c88729a23ffe1e591a0a646/cf 2023-07-17 12:12:20,179 INFO [StoreOpener-07b1a9065c88729a23ffe1e591a0a646-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 07b1a9065c88729a23ffe1e591a0a646 columnFamilyName cf 2023-07-17 12:12:20,187 INFO [StoreOpener-07b1a9065c88729a23ffe1e591a0a646-1] regionserver.HStore(310): Store=07b1a9065c88729a23ffe1e591a0a646/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 12:12:20,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/07b1a9065c88729a23ffe1e591a0a646 2023-07-17 12:12:20,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/07b1a9065c88729a23ffe1e591a0a646 2023-07-17 12:12:20,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ace9688399131e6f847023dee0e5e6c4 2023-07-17 12:12:20,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ace9688399131e6f847023dee0e5e6c4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 12:12:20,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 07b1a9065c88729a23ffe1e591a0a646 2023-07-17 12:12:20,194 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ace9688399131e6f847023dee0e5e6c4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73242560, jitterRate=0.0913991928100586}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 12:12:20,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ace9688399131e6f847023dee0e5e6c4: 2023-07-17 12:12:20,195 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939731.ace9688399131e6f847023dee0e5e6c4., pid=69, masterSystemTime=1689595940151 2023-07-17 12:12:20,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/07b1a9065c88729a23ffe1e591a0a646/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 12:12:20,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939731.ace9688399131e6f847023dee0e5e6c4. 2023-07-17 12:12:20,196 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939731.ace9688399131e6f847023dee0e5e6c4. 2023-07-17 12:12:20,197 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 07b1a9065c88729a23ffe1e591a0a646; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68238294, jitterRate=0.01682981848716736}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 12:12:20,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 07b1a9065c88729a23ffe1e591a0a646: 2023-07-17 12:12:20,198 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=ace9688399131e6f847023dee0e5e6c4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:20,198 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595939731.07b1a9065c88729a23ffe1e591a0a646., pid=70, masterSystemTime=1689595940162 2023-07-17 12:12:20,198 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939731.ace9688399131e6f847023dee0e5e6c4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689595940197"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689595940197"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689595940197"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689595940197"}]},"ts":"1689595940197"} 2023-07-17 12:12:20,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595939731.07b1a9065c88729a23ffe1e591a0a646. 2023-07-17 12:12:20,199 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595939731.07b1a9065c88729a23ffe1e591a0a646. 2023-07-17 12:12:20,200 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=07b1a9065c88729a23ffe1e591a0a646, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:20,200 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595939731.07b1a9065c88729a23ffe1e591a0a646.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689595940200"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689595940200"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689595940200"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689595940200"}]},"ts":"1689595940200"} 2023-07-17 12:12:20,206 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-17 12:12:20,206 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure ace9688399131e6f847023dee0e5e6c4, server=jenkins-hbase4.apache.org,34107,1689595859757 in 201 msec 2023-07-17 12:12:20,207 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-17 12:12:20,207 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ace9688399131e6f847023dee0e5e6c4, ASSIGN in 369 msec 2023-07-17 12:12:20,207 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 07b1a9065c88729a23ffe1e591a0a646, server=jenkins-hbase4.apache.org,44163,1689595859880 in 201 msec 2023-07-17 12:12:20,209 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-17 12:12:20,209 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=07b1a9065c88729a23ffe1e591a0a646, ASSIGN in 370 msec 2023-07-17 12:12:20,210 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 12:12:20,210 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595940210"}]},"ts":"1689595940210"} 2023-07-17 12:12:20,212 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-17 12:12:20,216 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 12:12:20,216 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-17 12:12:20,223 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44163] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-17 12:12:20,225 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:20,225 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:20,225 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:20,226 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:20,236 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 12:12:20,236 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-17 12:12:20,236 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 12:12:20,236 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-17 12:12:20,236 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 12:12:20,236 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 12:12:20,237 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-17 12:12:20,237 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-17 12:12:20,237 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 504 msec 2023-07-17 12:12:20,258 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-17 12:12:20,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-17 12:12:20,344 INFO [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-17 12:12:20,371 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions ace9688399131e6f847023dee0e5e6c4, 07b1a9065c88729a23ffe1e591a0a646 2023-07-17 12:12:20,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[ace9688399131e6f847023dee0e5e6c4, 07b1a9065c88729a23ffe1e591a0a646], force=true 2023-07-17 12:12:20,392 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[ace9688399131e6f847023dee0e5e6c4, 07b1a9065c88729a23ffe1e591a0a646], force=true 2023-07-17 12:12:20,392 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[ace9688399131e6f847023dee0e5e6c4, 07b1a9065c88729a23ffe1e591a0a646], force=true 2023-07-17 12:12:20,392 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[ace9688399131e6f847023dee0e5e6c4, 07b1a9065c88729a23ffe1e591a0a646], force=true 2023-07-17 12:12:20,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-17 12:12:20,431 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ace9688399131e6f847023dee0e5e6c4, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=07b1a9065c88729a23ffe1e591a0a646, UNASSIGN}] 2023-07-17 12:12:20,434 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ace9688399131e6f847023dee0e5e6c4, UNASSIGN 2023-07-17 12:12:20,434 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=07b1a9065c88729a23ffe1e591a0a646, UNASSIGN 2023-07-17 12:12:20,435 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=ace9688399131e6f847023dee0e5e6c4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:20,435 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=07b1a9065c88729a23ffe1e591a0a646, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:20,435 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939731.ace9688399131e6f847023dee0e5e6c4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689595940435"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595940435"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595940435"}]},"ts":"1689595940435"} 2023-07-17 12:12:20,435 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595939731.07b1a9065c88729a23ffe1e591a0a646.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689595940435"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595940435"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595940435"}]},"ts":"1689595940435"} 2023-07-17 12:12:20,437 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure ace9688399131e6f847023dee0e5e6c4, server=jenkins-hbase4.apache.org,34107,1689595859757}] 2023-07-17 12:12:20,438 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 07b1a9065c88729a23ffe1e591a0a646, server=jenkins-hbase4.apache.org,44163,1689595859880}] 2023-07-17 12:12:20,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-17 12:12:20,590 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ace9688399131e6f847023dee0e5e6c4 2023-07-17 12:12:20,591 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ace9688399131e6f847023dee0e5e6c4, disabling compactions & flushes 2023-07-17 12:12:20,592 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939731.ace9688399131e6f847023dee0e5e6c4. 2023-07-17 12:12:20,592 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939731.ace9688399131e6f847023dee0e5e6c4. 2023-07-17 12:12:20,592 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939731.ace9688399131e6f847023dee0e5e6c4. after waiting 0 ms 2023-07-17 12:12:20,592 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939731.ace9688399131e6f847023dee0e5e6c4. 2023-07-17 12:12:20,592 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing ace9688399131e6f847023dee0e5e6c4 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-17 12:12:20,592 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 07b1a9065c88729a23ffe1e591a0a646 2023-07-17 12:12:20,593 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 07b1a9065c88729a23ffe1e591a0a646, disabling compactions & flushes 2023-07-17 12:12:20,593 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595939731.07b1a9065c88729a23ffe1e591a0a646. 2023-07-17 12:12:20,594 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595939731.07b1a9065c88729a23ffe1e591a0a646. 2023-07-17 12:12:20,594 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595939731.07b1a9065c88729a23ffe1e591a0a646. after waiting 0 ms 2023-07-17 12:12:20,594 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595939731.07b1a9065c88729a23ffe1e591a0a646. 2023-07-17 12:12:20,594 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 07b1a9065c88729a23ffe1e591a0a646 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-17 12:12:20,639 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/07b1a9065c88729a23ffe1e591a0a646/.tmp/cf/854a5dce1c8b4d4ebdcf10465eabd54c 2023-07-17 12:12:20,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/07b1a9065c88729a23ffe1e591a0a646/.tmp/cf/854a5dce1c8b4d4ebdcf10465eabd54c as hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/07b1a9065c88729a23ffe1e591a0a646/cf/854a5dce1c8b4d4ebdcf10465eabd54c 2023-07-17 12:12:20,653 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/07b1a9065c88729a23ffe1e591a0a646/cf/854a5dce1c8b4d4ebdcf10465eabd54c, entries=1, sequenceid=5, filesize=4.7 K 2023-07-17 12:12:20,654 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 07b1a9065c88729a23ffe1e591a0a646 in 60ms, sequenceid=5, compaction requested=false 2023-07-17 12:12:20,664 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/07b1a9065c88729a23ffe1e591a0a646/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-17 12:12:20,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:12:20,665 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595939731.07b1a9065c88729a23ffe1e591a0a646. 2023-07-17 12:12:20,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 07b1a9065c88729a23ffe1e591a0a646: 2023-07-17 12:12:20,667 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 07b1a9065c88729a23ffe1e591a0a646 2023-07-17 12:12:20,667 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=07b1a9065c88729a23ffe1e591a0a646, regionState=CLOSED 2023-07-17 12:12:20,667 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595939731.07b1a9065c88729a23ffe1e591a0a646.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689595940667"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595940667"}]},"ts":"1689595940667"} 2023-07-17 12:12:20,670 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-17 12:12:20,670 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 07b1a9065c88729a23ffe1e591a0a646, server=jenkins-hbase4.apache.org,44163,1689595859880 in 231 msec 2023-07-17 12:12:20,672 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=07b1a9065c88729a23ffe1e591a0a646, UNASSIGN in 239 msec 2023-07-17 12:12:20,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-17 12:12:21,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-17 12:12:21,028 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ace9688399131e6f847023dee0e5e6c4/.tmp/cf/099a3586415248a6b760e941a2b3a943 2023-07-17 12:12:21,034 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867780_0004_000001 (auth:SIMPLE) 2023-07-17 12:12:21,042 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ace9688399131e6f847023dee0e5e6c4/.tmp/cf/099a3586415248a6b760e941a2b3a943 as hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ace9688399131e6f847023dee0e5e6c4/cf/099a3586415248a6b760e941a2b3a943 2023-07-17 12:12:21,048 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ace9688399131e6f847023dee0e5e6c4/cf/099a3586415248a6b760e941a2b3a943, entries=1, sequenceid=5, filesize=4.7 K 2023-07-17 12:12:21,049 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for ace9688399131e6f847023dee0e5e6c4 in 457ms, sequenceid=5, compaction requested=false 2023-07-17 12:12:21,059 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ace9688399131e6f847023dee0e5e6c4/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-17 12:12:21,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:12:21,060 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939731.ace9688399131e6f847023dee0e5e6c4. 2023-07-17 12:12:21,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ace9688399131e6f847023dee0e5e6c4: 2023-07-17 12:12:21,062 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ace9688399131e6f847023dee0e5e6c4 2023-07-17 12:12:21,063 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=ace9688399131e6f847023dee0e5e6c4, regionState=CLOSED 2023-07-17 12:12:21,063 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939731.ace9688399131e6f847023dee0e5e6c4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689595941063"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595941063"}]},"ts":"1689595941063"} 2023-07-17 12:12:21,067 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-17 12:12:21,067 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure ace9688399131e6f847023dee0e5e6c4, server=jenkins-hbase4.apache.org,34107,1689595859757 in 628 msec 2023-07-17 12:12:21,071 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-17 12:12:21,071 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ace9688399131e6f847023dee0e5e6c4, UNASSIGN in 639 msec 2023-07-17 12:12:21,130 DEBUG [PEWorker-3] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/234f34c7f24651978e3f6059f0567d2c/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-17 12:12:21,133 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939731.ace9688399131e6f847023dee0e5e6c4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-17 12:12:21,133 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689595939731.07b1a9065c88729a23ffe1e591a0a646.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-17 12:12:21,133 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939732.234f34c7f24651978e3f6059f0567d2c.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-17 12:12:21,189 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=234f34c7f24651978e3f6059f0567d2c, ASSIGN}] 2023-07-17 12:12:21,190 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=234f34c7f24651978e3f6059f0567d2c, ASSIGN 2023-07-17 12:12:21,191 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=234f34c7f24651978e3f6059f0567d2c, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,34107,1689595859757; forceNewPlan=false, retain=false 2023-07-17 12:12:21,342 INFO [jenkins-hbase4:35573] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-17 12:12:21,344 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=234f34c7f24651978e3f6059f0567d2c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:21,344 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939732.234f34c7f24651978e3f6059f0567d2c.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689595941344"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595941344"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595941344"}]},"ts":"1689595941344"} 2023-07-17 12:12:21,347 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 234f34c7f24651978e3f6059f0567d2c, server=jenkins-hbase4.apache.org,34107,1689595859757}] 2023-07-17 12:12:21,504 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939732.234f34c7f24651978e3f6059f0567d2c. 2023-07-17 12:12:21,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 234f34c7f24651978e3f6059f0567d2c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939732.234f34c7f24651978e3f6059f0567d2c.', STARTKEY => '', ENDKEY => ''} 2023-07-17 12:12:21,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939732.234f34c7f24651978e3f6059f0567d2c. service=AccessControlService 2023-07-17 12:12:21,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-17 12:12:21,505 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 12:12:21,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 234f34c7f24651978e3f6059f0567d2c 2023-07-17 12:12:21,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939732.234f34c7f24651978e3f6059f0567d2c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:12:21,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 234f34c7f24651978e3f6059f0567d2c 2023-07-17 12:12:21,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 234f34c7f24651978e3f6059f0567d2c 2023-07-17 12:12:21,506 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/234f34c7f24651978e3f6059f0567d2c/.regioninfo 2023-07-17 12:12:21,524 INFO [StoreOpener-234f34c7f24651978e3f6059f0567d2c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 234f34c7f24651978e3f6059f0567d2c 2023-07-17 12:12:21,525 DEBUG [StoreOpener-234f34c7f24651978e3f6059f0567d2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/234f34c7f24651978e3f6059f0567d2c/cf 2023-07-17 12:12:21,525 DEBUG [StoreOpener-234f34c7f24651978e3f6059f0567d2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/234f34c7f24651978e3f6059f0567d2c/cf 2023-07-17 12:12:21,526 INFO [StoreOpener-234f34c7f24651978e3f6059f0567d2c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 234f34c7f24651978e3f6059f0567d2c columnFamilyName cf 2023-07-17 12:12:21,561 DEBUG [StoreOpener-234f34c7f24651978e3f6059f0567d2c-1] regionserver.HStore(539): loaded hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/234f34c7f24651978e3f6059f0567d2c/cf/099a3586415248a6b760e941a2b3a943.ace9688399131e6f847023dee0e5e6c4->hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ace9688399131e6f847023dee0e5e6c4/cf/099a3586415248a6b760e941a2b3a943-top 2023-07-17 12:12:21,571 DEBUG [StoreOpener-234f34c7f24651978e3f6059f0567d2c-1] regionserver.HStore(539): loaded hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/234f34c7f24651978e3f6059f0567d2c/cf/854a5dce1c8b4d4ebdcf10465eabd54c.07b1a9065c88729a23ffe1e591a0a646->hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/07b1a9065c88729a23ffe1e591a0a646/cf/854a5dce1c8b4d4ebdcf10465eabd54c-top 2023-07-17 12:12:21,571 INFO [StoreOpener-234f34c7f24651978e3f6059f0567d2c-1] regionserver.HStore(310): Store=234f34c7f24651978e3f6059f0567d2c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 12:12:21,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/234f34c7f24651978e3f6059f0567d2c 2023-07-17 12:12:21,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/234f34c7f24651978e3f6059f0567d2c 2023-07-17 12:12:21,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 234f34c7f24651978e3f6059f0567d2c 2023-07-17 12:12:21,579 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 234f34c7f24651978e3f6059f0567d2c; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59451820, jitterRate=-0.11409884691238403}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 12:12:21,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 234f34c7f24651978e3f6059f0567d2c: 2023-07-17 12:12:21,580 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939732.234f34c7f24651978e3f6059f0567d2c., pid=77, masterSystemTime=1689595941500 2023-07-17 12:12:21,580 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939732.234f34c7f24651978e3f6059f0567d2c.,because compaction is disabled. 2023-07-17 12:12:21,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939732.234f34c7f24651978e3f6059f0567d2c. 2023-07-17 12:12:21,582 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939732.234f34c7f24651978e3f6059f0567d2c. 2023-07-17 12:12:21,582 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=234f34c7f24651978e3f6059f0567d2c, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:21,582 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939732.234f34c7f24651978e3f6059f0567d2c.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689595941582"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689595941582"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689595941582"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689595941582"}]},"ts":"1689595941582"} 2023-07-17 12:12:21,587 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-17 12:12:21,587 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 234f34c7f24651978e3f6059f0567d2c, server=jenkins-hbase4.apache.org,34107,1689595859757 in 237 msec 2023-07-17 12:12:21,590 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-17 12:12:21,590 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=234f34c7f24651978e3f6059f0567d2c, ASSIGN in 398 msec 2023-07-17 12:12:21,593 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[ace9688399131e6f847023dee0e5e6c4, 07b1a9065c88729a23ffe1e591a0a646], force=true in 1.2150 sec 2023-07-17 12:12:22,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-17 12:12:22,506 INFO [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-17 12:12:22,506 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-17 12:12:22,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689595942506 (current time:1689595942506). 2023-07-17 12:12:22,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 12:12:22,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(139): Connect 0x40aabdc1 to 127.0.0.1:60075 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:12:22,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1043a97a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:12:22,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:12:22,518 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39890, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:12:22,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x40aabdc1 to 127.0.0.1:60075 2023-07-17 12:12:22,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:12:22,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(139): Connect 0x58374425 to 127.0.0.1:60075 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:12:22,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d66be57, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:12:22,529 DEBUG [hconnection-0x40e3c6f8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:12:22,532 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39906, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:12:22,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:12:22,539 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60680, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:12:22,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x58374425 to 127.0.0.1:60075 2023-07-17 12:12:22,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:12:22,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-17 12:12:22,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 12:12:22,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-17 12:12:22,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-17 12:12:22,557 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-17 12:12:22,558 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689596542558 2023-07-17 12:12:22,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-17 12:12:22,558 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,563 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 12:12:22,563 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 12:12:22,565 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-17 12:12:22,565 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-17 12:12:22,567 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 13 msec 2023-07-17 12:12:22,568 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-17 12:12:22,569 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689596542569 2023-07-17 12:12:22,586 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,587 INFO [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-17 12:12:22,587 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:22,588 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-17 12:12:22,588 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-17 12:12:22,589 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,589 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,591 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:22,591 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:22,591 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:22,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:22,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:22,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:22,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:22,591 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:22,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:22,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:22,591 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:22,591 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 12:12:22,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,592 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,593 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-17 12:12:22,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-17 12:12:22,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,593 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-17 12:12:22,593 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-17 12:12:22,594 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,594 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-17 12:12:22,594 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:22,594 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,596 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-17 12:12:22,596 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-17 12:12:22,596 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:22,596 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-17 12:12:22,598 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37767,1689595859826' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-17 12:12:22,598 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-17 12:12:22,598 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-17 12:12:22,598 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34107,1689595859757' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-17 12:12:22,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,599 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,600 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,600 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:22,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:22,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:22,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:22,602 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:22,602 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,602 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:12:22,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-17 12:12:22,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,602 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-17 12:12:22,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:22,602 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,603 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:12:22,603 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,603 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-17 12:12:22,603 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:22,604 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-17 12:12:22,604 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-17 12:12:22,604 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44163,1689595859880' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-17 12:12:22,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:22,607 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:22,608 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:22,608 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:12:22,608 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34107,1689595859757' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-17 12:12:22,608 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b878035[Count = 0] remaining members to acquire global barrier 2023-07-17 12:12:22,608 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-17 12:12:22,608 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,610 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,610 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,611 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-17 12:12:22,611 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-17 12:12:22,611 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-17 12:12:22,611 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-17 12:12:22,611 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,37767,1689595859826' in zk 2023-07-17 12:12:22,611 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,44163,1689595859880' in zk 2023-07-17 12:12:22,612 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,612 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-17 12:12:22,613 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-17 12:12:22,613 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:22,613 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-17 12:12:22,614 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:12:22,616 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:12:22,616 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:22,616 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 12:12:22,618 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939732.234f34c7f24651978e3f6059f0567d2c. 2023-07-17 12:12:22,619 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939732.234f34c7f24651978e3f6059f0567d2c. started... 2023-07-17 12:12:22,620 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 234f34c7f24651978e3f6059f0567d2c: 2023-07-17 12:12:22,620 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939732.234f34c7f24651978e3f6059f0567d2c.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,621 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:12:22,621 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/234f34c7f24651978e3f6059f0567d2c/cf/099a3586415248a6b760e941a2b3a943.ace9688399131e6f847023dee0e5e6c4->hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ace9688399131e6f847023dee0e5e6c4/cf/099a3586415248a6b760e941a2b3a943-top, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/234f34c7f24651978e3f6059f0567d2c/cf/854a5dce1c8b4d4ebdcf10465eabd54c.07b1a9065c88729a23ffe1e591a0a646->hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/07b1a9065c88729a23ffe1e591a0a646/cf/854a5dce1c8b4d4ebdcf10465eabd54c-top] hfiles 2023-07-17 12:12:22,621 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/234f34c7f24651978e3f6059f0567d2c/cf/099a3586415248a6b760e941a2b3a943.ace9688399131e6f847023dee0e5e6c4 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,621 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-17 12:12:22,621 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:22,621 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-17 12:12:22,627 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/234f34c7f24651978e3f6059f0567d2c/cf/854a5dce1c8b4d4ebdcf10465eabd54c.07b1a9065c88729a23ffe1e591a0a646 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,642 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939732.234f34c7f24651978e3f6059f0567d2c. completed. 2023-07-17 12:12:22,642 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939732.234f34c7f24651978e3f6059f0567d2c. 2023-07-17 12:12:22,642 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:12:22,642 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:12:22,642 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:22,642 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-17 12:12:22,642 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,34107,1689595859757' in zk 2023-07-17 12:12:22,648 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:22,648 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-17 12:12:22,648 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:22,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:22,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:22,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:22,648 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-17 12:12:22,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:22,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:22,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:22,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:22,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:22,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:22,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:22,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:22,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:22,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,34107,1689595859757': 2023-07-17 12:12:22,655 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34107,1689595859757' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-17 12:12:22,655 INFO [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-17 12:12:22,655 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 12:12:22,655 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 12:12:22,655 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,655 INFO [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 12:12:22,657 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,657 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,658 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:22,657 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,657 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:22,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:22,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,658 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:22,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,657 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:22,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:22,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,658 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:22,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:22,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:22,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:22,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:22,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:22,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,659 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:22,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:22,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:22,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,660 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:22,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:22,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:22,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:22,662 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:22,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:22,663 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:22,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,663 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:22,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:22,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:22,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:22,666 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:12:22,667 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:22,667 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:22,667 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:22,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:22,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:22,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:22,668 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:22,667 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:22,668 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,668 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:22,668 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:22,668 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,668 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:22,668 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,668 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:22,668 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:22,668 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:22,668 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:22,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:22,668 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:22,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:22,668 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:22,668 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,668 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:22,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:22,669 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:22,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:22,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:22,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:22,669 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:22,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-17 12:12:22,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:12:22,671 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 12:12:22,805 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 12:12:22,872 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:12:22,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-17 12:12:22,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:12:22,873 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 12:12:23,099 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:23,136 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-17 12:12:23,136 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:23,136 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:23,136 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689595942558Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689595942668 (+110 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689595942669 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689595942673 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689595943091 (+418 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689595943136 (+45 ms) 2023-07-17 12:12:23,139 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-17 12:12:23,141 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 576 msec 2023-07-17 12:12:23,173 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:12:23,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-17 12:12:23,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 12:12:23,175 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595943175 2023-07-17 12:12:23,175 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40781, tgtDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595943175, rawTgtDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595943175, srcFsUri=hdfs://localhost:40781, srcDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c 2023-07-17 12:12:23,202 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40781, inputRoot=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c 2023-07-17 12:12:23,203 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1231764039_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595943175, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595943175/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:23,203 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40781, inputRoot=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c, snapshotDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-17 12:12:23,212 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595943175/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:23,236 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:23,236 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:23,237 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:23,237 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:23,238 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:23,238 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:23,238 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:23,326 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/hadoop-8763367970235274155.jar 2023-07-17 12:12:23,327 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:23,327 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:23,327 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:23,328 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:23,328 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:23,328 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:23,329 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-17 12:12:23,329 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-17 12:12:23,330 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-17 12:12:23,330 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-17 12:12:23,330 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-17 12:12:23,331 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-17 12:12:23,331 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-17 12:12:23,332 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-17 12:12:23,332 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-17 12:12:23,332 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-17 12:12:23,333 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:12:23,333 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:12:23,334 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 12:12:23,334 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:12:23,334 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:12:23,335 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 12:12:23,335 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 12:12:24,787 WARN [Listener at jenkins-hbase4.apache.org/42275] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-17 12:12:24,792 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-17 12:12:24,794 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-17 12:12:24,967 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 12:12:24,967 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 12:12:25,050 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867780_0005_000001 (auth:SIMPLE) 2023-07-17 12:12:31,117 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867780_0005_000001 (auth:SIMPLE) 2023-07-17 12:12:33,425 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867780_0005_000001 (auth:SIMPLE) 2023-07-17 12:12:38,255 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867780_0005_000001 (auth:SIMPLE) 2023-07-17 12:12:40,147 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-17 12:12:40,155 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-17 12:12:40,165 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:40,165 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-17 12:12:40,165 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-17 12:12:40,166 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-269744684_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:40,167 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(367): hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-17 12:12:40,167 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(367): hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-17 12:12:40,167 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-269744684_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595943175/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595943175/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:40,168 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(367): hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595943175/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-17 12:12:40,168 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(367): hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595943175/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-17 12:12:40,181 INFO [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:40,181 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:40,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:40,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-17 12:12:40,186 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595960186"}]},"ts":"1689595960186"} 2023-07-17 12:12:40,187 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-17 12:12:40,188 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-17 12:12:40,189 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=234f34c7f24651978e3f6059f0567d2c, UNASSIGN}] 2023-07-17 12:12:40,193 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=234f34c7f24651978e3f6059f0567d2c, UNASSIGN 2023-07-17 12:12:40,193 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=234f34c7f24651978e3f6059f0567d2c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:40,193 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939732.234f34c7f24651978e3f6059f0567d2c.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689595960193"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595960193"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595960193"}]},"ts":"1689595960193"} 2023-07-17 12:12:40,195 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 234f34c7f24651978e3f6059f0567d2c, server=jenkins-hbase4.apache.org,34107,1689595859757}] 2023-07-17 12:12:40,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-17 12:12:40,347 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 234f34c7f24651978e3f6059f0567d2c 2023-07-17 12:12:40,347 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 234f34c7f24651978e3f6059f0567d2c, disabling compactions & flushes 2023-07-17 12:12:40,347 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939732.234f34c7f24651978e3f6059f0567d2c. 2023-07-17 12:12:40,347 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939732.234f34c7f24651978e3f6059f0567d2c. 2023-07-17 12:12:40,347 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939732.234f34c7f24651978e3f6059f0567d2c. after waiting 0 ms 2023-07-17 12:12:40,347 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939732.234f34c7f24651978e3f6059f0567d2c. 2023-07-17 12:12:40,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/234f34c7f24651978e3f6059f0567d2c/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-17 12:12:40,358 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:12:40,359 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939732.234f34c7f24651978e3f6059f0567d2c. 2023-07-17 12:12:40,359 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 234f34c7f24651978e3f6059f0567d2c: 2023-07-17 12:12:40,360 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 234f34c7f24651978e3f6059f0567d2c 2023-07-17 12:12:40,361 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=234f34c7f24651978e3f6059f0567d2c, regionState=CLOSED 2023-07-17 12:12:40,361 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939732.234f34c7f24651978e3f6059f0567d2c.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689595960361"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595960361"}]},"ts":"1689595960361"} 2023-07-17 12:12:40,364 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-17 12:12:40,364 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 234f34c7f24651978e3f6059f0567d2c, server=jenkins-hbase4.apache.org,34107,1689595859757 in 167 msec 2023-07-17 12:12:40,365 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-17 12:12:40,365 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=234f34c7f24651978e3f6059f0567d2c, UNASSIGN in 175 msec 2023-07-17 12:12:40,370 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595960370"}]},"ts":"1689595960370"} 2023-07-17 12:12:40,375 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-17 12:12:40,376 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-17 12:12:40,378 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 195 msec 2023-07-17 12:12:40,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-17 12:12:40,489 INFO [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-17 12:12:40,490 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:40,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:40,493 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:40,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:40,494 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:40,496 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44163] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:40,500 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:40,500 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:40,500 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:40,500 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:40,501 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-17 12:12:40,501 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-17 12:12:40,501 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-17 12:12:40,501 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-17 12:12:40,502 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:40,502 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:40,502 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:40,502 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:40,502 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:40,502 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:40,502 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:40,502 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:40,503 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 12:12:40,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-17 12:12:40,503 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 12:12:40,503 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 12:12:40,504 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 12:12:40,509 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/234f34c7f24651978e3f6059f0567d2c 2023-07-17 12:12:40,512 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/234f34c7f24651978e3f6059f0567d2c/cf, FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/234f34c7f24651978e3f6059f0567d2c/recovered.edits] 2023-07-17 12:12:40,520 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/07b1a9065c88729a23ffe1e591a0a646 2023-07-17 12:12:40,520 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ace9688399131e6f847023dee0e5e6c4 2023-07-17 12:12:40,523 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/07b1a9065c88729a23ffe1e591a0a646/cf, FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/07b1a9065c88729a23ffe1e591a0a646/recovered.edits] 2023-07-17 12:12:40,524 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ace9688399131e6f847023dee0e5e6c4/cf, FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ace9688399131e6f847023dee0e5e6c4/recovered.edits] 2023-07-17 12:12:40,540 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ace9688399131e6f847023dee0e5e6c4/cf/099a3586415248a6b760e941a2b3a943 to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ace9688399131e6f847023dee0e5e6c4/cf/099a3586415248a6b760e941a2b3a943 2023-07-17 12:12:40,543 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/07b1a9065c88729a23ffe1e591a0a646/cf/854a5dce1c8b4d4ebdcf10465eabd54c to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/07b1a9065c88729a23ffe1e591a0a646/cf/854a5dce1c8b4d4ebdcf10465eabd54c 2023-07-17 12:12:40,543 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ace9688399131e6f847023dee0e5e6c4/recovered.edits/8.seqid to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ace9688399131e6f847023dee0e5e6c4/recovered.edits/8.seqid 2023-07-17 12:12:40,545 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ace9688399131e6f847023dee0e5e6c4 2023-07-17 12:12:40,548 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/07b1a9065c88729a23ffe1e591a0a646/recovered.edits/8.seqid to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/07b1a9065c88729a23ffe1e591a0a646/recovered.edits/8.seqid 2023-07-17 12:12:40,548 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/07b1a9065c88729a23ffe1e591a0a646 2023-07-17 12:12:40,549 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/234f34c7f24651978e3f6059f0567d2c/cf/099a3586415248a6b760e941a2b3a943.ace9688399131e6f847023dee0e5e6c4 to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/234f34c7f24651978e3f6059f0567d2c/cf/099a3586415248a6b760e941a2b3a943.ace9688399131e6f847023dee0e5e6c4 2023-07-17 12:12:40,551 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/234f34c7f24651978e3f6059f0567d2c/cf/854a5dce1c8b4d4ebdcf10465eabd54c.07b1a9065c88729a23ffe1e591a0a646 to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/234f34c7f24651978e3f6059f0567d2c/cf/854a5dce1c8b4d4ebdcf10465eabd54c.07b1a9065c88729a23ffe1e591a0a646 2023-07-17 12:12:40,553 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/234f34c7f24651978e3f6059f0567d2c/recovered.edits/12.seqid to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/234f34c7f24651978e3f6059f0567d2c/recovered.edits/12.seqid 2023-07-17 12:12:40,554 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/234f34c7f24651978e3f6059f0567d2c 2023-07-17 12:12:40,554 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-17 12:12:40,556 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:40,564 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-17 12:12:40,568 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-17 12:12:40,570 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:40,570 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-17 12:12:40,570 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939732.234f34c7f24651978e3f6059f0567d2c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689595960570"}]},"ts":"9223372036854775807"} 2023-07-17 12:12:40,573 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-17 12:12:40,573 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 234f34c7f24651978e3f6059f0567d2c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689595939732.234f34c7f24651978e3f6059f0567d2c.', STARTKEY => '', ENDKEY => ''}] 2023-07-17 12:12:40,573 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-17 12:12:40,573 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689595960573"}]},"ts":"9223372036854775807"} 2023-07-17 12:12:40,579 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-17 12:12:40,582 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:40,585 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 92 msec 2023-07-17 12:12:40,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-17 12:12:40,605 INFO [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-17 12:12:40,605 INFO [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:40,606 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:40,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:40,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-17 12:12:40,611 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595960610"}]},"ts":"1689595960610"} 2023-07-17 12:12:40,612 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-17 12:12:40,615 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-17 12:12:40,615 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0b469747bd2677ee324c2aa0a8b29f81, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=56130c84af27d11011d1035a53f12b8d, UNASSIGN}] 2023-07-17 12:12:40,618 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0b469747bd2677ee324c2aa0a8b29f81, UNASSIGN 2023-07-17 12:12:40,618 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=56130c84af27d11011d1035a53f12b8d, UNASSIGN 2023-07-17 12:12:40,618 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=0b469747bd2677ee324c2aa0a8b29f81, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:40,619 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689595937777.0b469747bd2677ee324c2aa0a8b29f81.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689595960618"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595960618"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595960618"}]},"ts":"1689595960618"} 2023-07-17 12:12:40,620 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=56130c84af27d11011d1035a53f12b8d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:40,620 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689595937777.56130c84af27d11011d1035a53f12b8d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689595960620"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595960620"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595960620"}]},"ts":"1689595960620"} 2023-07-17 12:12:40,621 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 0b469747bd2677ee324c2aa0a8b29f81, server=jenkins-hbase4.apache.org,44163,1689595859880}] 2023-07-17 12:12:40,622 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 56130c84af27d11011d1035a53f12b8d, server=jenkins-hbase4.apache.org,34107,1689595859757}] 2023-07-17 12:12:40,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-17 12:12:40,774 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0b469747bd2677ee324c2aa0a8b29f81 2023-07-17 12:12:40,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0b469747bd2677ee324c2aa0a8b29f81, disabling compactions & flushes 2023-07-17 12:12:40,774 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689595937777.0b469747bd2677ee324c2aa0a8b29f81. 2023-07-17 12:12:40,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689595937777.0b469747bd2677ee324c2aa0a8b29f81. 2023-07-17 12:12:40,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689595937777.0b469747bd2677ee324c2aa0a8b29f81. after waiting 0 ms 2023-07-17 12:12:40,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689595937777.0b469747bd2677ee324c2aa0a8b29f81. 2023-07-17 12:12:40,775 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 56130c84af27d11011d1035a53f12b8d 2023-07-17 12:12:40,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 56130c84af27d11011d1035a53f12b8d, disabling compactions & flushes 2023-07-17 12:12:40,779 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689595937777.56130c84af27d11011d1035a53f12b8d. 2023-07-17 12:12:40,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689595937777.56130c84af27d11011d1035a53f12b8d. 2023-07-17 12:12:40,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689595937777.56130c84af27d11011d1035a53f12b8d. after waiting 0 ms 2023-07-17 12:12:40,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689595937777.56130c84af27d11011d1035a53f12b8d. 2023-07-17 12:12:40,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b469747bd2677ee324c2aa0a8b29f81/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 12:12:40,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithMergeRegion/56130c84af27d11011d1035a53f12b8d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 12:12:40,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:12:40,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:12:40,789 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689595937777.56130c84af27d11011d1035a53f12b8d. 2023-07-17 12:12:40,790 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689595937777.0b469747bd2677ee324c2aa0a8b29f81. 2023-07-17 12:12:40,790 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 56130c84af27d11011d1035a53f12b8d: 2023-07-17 12:12:40,790 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0b469747bd2677ee324c2aa0a8b29f81: 2023-07-17 12:12:40,792 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0b469747bd2677ee324c2aa0a8b29f81 2023-07-17 12:12:40,792 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=0b469747bd2677ee324c2aa0a8b29f81, regionState=CLOSED 2023-07-17 12:12:40,792 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689595937777.0b469747bd2677ee324c2aa0a8b29f81.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689595960792"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595960792"}]},"ts":"1689595960792"} 2023-07-17 12:12:40,792 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 56130c84af27d11011d1035a53f12b8d 2023-07-17 12:12:40,793 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=56130c84af27d11011d1035a53f12b8d, regionState=CLOSED 2023-07-17 12:12:40,793 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689595937777.56130c84af27d11011d1035a53f12b8d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689595960793"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595960793"}]},"ts":"1689595960793"} 2023-07-17 12:12:40,796 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-17 12:12:40,796 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 0b469747bd2677ee324c2aa0a8b29f81, server=jenkins-hbase4.apache.org,44163,1689595859880 in 173 msec 2023-07-17 12:12:40,797 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-17 12:12:40,797 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 56130c84af27d11011d1035a53f12b8d, server=jenkins-hbase4.apache.org,34107,1689595859757 in 173 msec 2023-07-17 12:12:40,798 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0b469747bd2677ee324c2aa0a8b29f81, UNASSIGN in 181 msec 2023-07-17 12:12:40,799 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-17 12:12:40,799 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=56130c84af27d11011d1035a53f12b8d, UNASSIGN in 183 msec 2023-07-17 12:12:40,800 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595960800"}]},"ts":"1689595960800"} 2023-07-17 12:12:40,801 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-17 12:12:40,803 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-17 12:12:40,805 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 198 msec 2023-07-17 12:12:40,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-17 12:12:40,914 INFO [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-17 12:12:40,915 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:40,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:40,918 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:40,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:40,919 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:40,920 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44163] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:40,923 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:40,923 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:40,923 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:40,923 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:40,923 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b469747bd2677ee324c2aa0a8b29f81 2023-07-17 12:12:40,923 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-17 12:12:40,923 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-17 12:12:40,923 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-17 12:12:40,923 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-17 12:12:40,923 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/56130c84af27d11011d1035a53f12b8d 2023-07-17 12:12:40,925 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b469747bd2677ee324c2aa0a8b29f81/cf, FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b469747bd2677ee324c2aa0a8b29f81/recovered.edits] 2023-07-17 12:12:40,925 DEBUG [HFileArchiver-16] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/56130c84af27d11011d1035a53f12b8d/cf, FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/56130c84af27d11011d1035a53f12b8d/recovered.edits] 2023-07-17 12:12:40,926 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:40,926 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:40,926 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:40,926 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:40,926 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:40,926 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:40,926 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:40,926 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:40,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-17 12:12:40,931 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b469747bd2677ee324c2aa0a8b29f81/cf/ac732fbffba24d1a88b53c44703d8809 to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b469747bd2677ee324c2aa0a8b29f81/cf/ac732fbffba24d1a88b53c44703d8809 2023-07-17 12:12:40,931 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/56130c84af27d11011d1035a53f12b8d/cf/44abed0e450146c2acca8f848de9d238 to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/56130c84af27d11011d1035a53f12b8d/cf/44abed0e450146c2acca8f848de9d238 2023-07-17 12:12:40,938 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b469747bd2677ee324c2aa0a8b29f81/recovered.edits/9.seqid to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b469747bd2677ee324c2aa0a8b29f81/recovered.edits/9.seqid 2023-07-17 12:12:40,939 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/56130c84af27d11011d1035a53f12b8d/recovered.edits/9.seqid to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/56130c84af27d11011d1035a53f12b8d/recovered.edits/9.seqid 2023-07-17 12:12:40,939 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b469747bd2677ee324c2aa0a8b29f81 2023-07-17 12:12:40,940 DEBUG [HFileArchiver-16] backup.HFileArchiver(596): Deleted hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/56130c84af27d11011d1035a53f12b8d 2023-07-17 12:12:40,940 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-17 12:12:40,942 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:40,945 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-17 12:12:40,947 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-17 12:12:40,948 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:40,948 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-17 12:12:40,948 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689595937777.0b469747bd2677ee324c2aa0a8b29f81.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689595960948"}]},"ts":"9223372036854775807"} 2023-07-17 12:12:40,948 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689595937777.56130c84af27d11011d1035a53f12b8d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689595960948"}]},"ts":"9223372036854775807"} 2023-07-17 12:12:40,950 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-17 12:12:40,950 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0b469747bd2677ee324c2aa0a8b29f81, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689595937777.0b469747bd2677ee324c2aa0a8b29f81.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 56130c84af27d11011d1035a53f12b8d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689595937777.56130c84af27d11011d1035a53f12b8d.', STARTKEY => '1', ENDKEY => ''}] 2023-07-17 12:12:40,950 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-17 12:12:40,950 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689595960950"}]},"ts":"9223372036854775807"} 2023-07-17 12:12:40,951 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-17 12:12:40,953 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:40,954 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 38 msec 2023-07-17 12:12:41,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-17 12:12:41,031 INFO [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-17 12:12:41,042 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-17 12:12:41,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:41,046 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-17 12:12:41,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 12:12:41,049 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-17 12:12:41,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 12:12:41,088 INFO [Listener at jenkins-hbase4.apache.org/42275] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=761 (was 746) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-269744684_17 at /127.0.0.1:49192 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3938 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x24b8e848-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x24b8e848-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x24b8e848-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x24b8e848-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1856735392_1 at /127.0.0.1:46954 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x24b8e848-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-269744684_17 at /127.0.0.1:56592 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (905985230) connection to jenkins-hbase4.apache.org/172.31.14.131:42275 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-269744684_17 at /127.0.0.1:45618 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x24b8e848-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (905985230) connection to jenkins-hbase4.apache.org/172.31.14.131:38135 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=914 (was 892) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=560 (was 469) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 183), AvailableMemoryMB=2364 (was 2579) 2023-07-17 12:12:41,088 WARN [Listener at jenkins-hbase4.apache.org/42275] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-17 12:12:41,115 INFO [Listener at jenkins-hbase4.apache.org/42275] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=761, OpenFileDescriptor=914, MaxFileDescriptor=60000, SystemLoadAverage=560, ProcessCount=183, AvailableMemoryMB=2360 2023-07-17 12:12:41,115 WARN [Listener at jenkins-hbase4.apache.org/42275] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-17 12:12:41,117 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-17 12:12:41,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 12:12:41,121 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 12:12:41,121 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-17 12:12:41,122 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 12:12:41,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-17 12:12:41,129 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testEmptyExportFileSystemState/7a74d5f0eeeb2ef6e6904242e62acc1d 2023-07-17 12:12:41,129 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testEmptyExportFileSystemState/3e92bc8ff3c25b6361b9004be734ad48 2023-07-17 12:12:41,130 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testEmptyExportFileSystemState/7a74d5f0eeeb2ef6e6904242e62acc1d empty. 2023-07-17 12:12:41,130 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testEmptyExportFileSystemState/3e92bc8ff3c25b6361b9004be734ad48 empty. 2023-07-17 12:12:41,131 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testEmptyExportFileSystemState/7a74d5f0eeeb2ef6e6904242e62acc1d 2023-07-17 12:12:41,132 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testEmptyExportFileSystemState/3e92bc8ff3c25b6361b9004be734ad48 2023-07-17 12:12:41,132 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-17 12:12:41,162 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-17 12:12:41,167 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 7a74d5f0eeeb2ef6e6904242e62acc1d, NAME => 'testtb-testEmptyExportFileSystemState,1,1689595961117.7a74d5f0eeeb2ef6e6904242e62acc1d.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp 2023-07-17 12:12:41,167 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3e92bc8ff3c25b6361b9004be734ad48, NAME => 'testtb-testEmptyExportFileSystemState,,1689595961117.3e92bc8ff3c25b6361b9004be734ad48.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp 2023-07-17 12:12:41,191 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689595961117.7a74d5f0eeeb2ef6e6904242e62acc1d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:12:41,192 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 7a74d5f0eeeb2ef6e6904242e62acc1d, disabling compactions & flushes 2023-07-17 12:12:41,192 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689595961117.7a74d5f0eeeb2ef6e6904242e62acc1d. 2023-07-17 12:12:41,192 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689595961117.7a74d5f0eeeb2ef6e6904242e62acc1d. 2023-07-17 12:12:41,192 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689595961117.7a74d5f0eeeb2ef6e6904242e62acc1d. after waiting 0 ms 2023-07-17 12:12:41,192 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689595961117.7a74d5f0eeeb2ef6e6904242e62acc1d. 2023-07-17 12:12:41,192 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689595961117.7a74d5f0eeeb2ef6e6904242e62acc1d. 2023-07-17 12:12:41,192 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 7a74d5f0eeeb2ef6e6904242e62acc1d: 2023-07-17 12:12:41,195 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689595961117.3e92bc8ff3c25b6361b9004be734ad48.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:12:41,195 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 3e92bc8ff3c25b6361b9004be734ad48, disabling compactions & flushes 2023-07-17 12:12:41,195 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689595961117.3e92bc8ff3c25b6361b9004be734ad48. 2023-07-17 12:12:41,195 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689595961117.3e92bc8ff3c25b6361b9004be734ad48. 2023-07-17 12:12:41,195 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689595961117.3e92bc8ff3c25b6361b9004be734ad48. after waiting 0 ms 2023-07-17 12:12:41,195 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689595961117.3e92bc8ff3c25b6361b9004be734ad48. 2023-07-17 12:12:41,195 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689595961117.3e92bc8ff3c25b6361b9004be734ad48. 2023-07-17 12:12:41,195 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 3e92bc8ff3c25b6361b9004be734ad48: 2023-07-17 12:12:41,198 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 12:12:41,199 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689595961117.7a74d5f0eeeb2ef6e6904242e62acc1d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689595961199"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595961199"}]},"ts":"1689595961199"} 2023-07-17 12:12:41,199 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689595961117.3e92bc8ff3c25b6361b9004be734ad48.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689595961199"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595961199"}]},"ts":"1689595961199"} 2023-07-17 12:12:41,202 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-17 12:12:41,202 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 12:12:41,203 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595961202"}]},"ts":"1689595961202"} 2023-07-17 12:12:41,204 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-17 12:12:41,209 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 12:12:41,211 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 12:12:41,211 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 12:12:41,211 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 12:12:41,211 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 12:12:41,211 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3e92bc8ff3c25b6361b9004be734ad48, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7a74d5f0eeeb2ef6e6904242e62acc1d, ASSIGN}] 2023-07-17 12:12:41,214 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7a74d5f0eeeb2ef6e6904242e62acc1d, ASSIGN 2023-07-17 12:12:41,214 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3e92bc8ff3c25b6361b9004be734ad48, ASSIGN 2023-07-17 12:12:41,214 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7a74d5f0eeeb2ef6e6904242e62acc1d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44163,1689595859880; forceNewPlan=false, retain=false 2023-07-17 12:12:41,215 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3e92bc8ff3c25b6361b9004be734ad48, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34107,1689595859757; forceNewPlan=false, retain=false 2023-07-17 12:12:41,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-17 12:12:41,365 INFO [jenkins-hbase4:35573] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-17 12:12:41,368 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=3e92bc8ff3c25b6361b9004be734ad48, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:41,368 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=7a74d5f0eeeb2ef6e6904242e62acc1d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:41,368 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689595961117.3e92bc8ff3c25b6361b9004be734ad48.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689595961368"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595961368"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595961368"}]},"ts":"1689595961368"} 2023-07-17 12:12:41,368 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689595961117.7a74d5f0eeeb2ef6e6904242e62acc1d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689595961368"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595961368"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595961368"}]},"ts":"1689595961368"} 2023-07-17 12:12:41,370 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 3e92bc8ff3c25b6361b9004be734ad48, server=jenkins-hbase4.apache.org,34107,1689595859757}] 2023-07-17 12:12:41,370 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 7a74d5f0eeeb2ef6e6904242e62acc1d, server=jenkins-hbase4.apache.org,44163,1689595859880}] 2023-07-17 12:12:41,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-17 12:12:41,527 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689595961117.3e92bc8ff3c25b6361b9004be734ad48. 2023-07-17 12:12:41,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3e92bc8ff3c25b6361b9004be734ad48, NAME => 'testtb-testEmptyExportFileSystemState,,1689595961117.3e92bc8ff3c25b6361b9004be734ad48.', STARTKEY => '', ENDKEY => '1'} 2023-07-17 12:12:41,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689595961117.3e92bc8ff3c25b6361b9004be734ad48. service=AccessControlService 2023-07-17 12:12:41,528 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 12:12:41,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 3e92bc8ff3c25b6361b9004be734ad48 2023-07-17 12:12:41,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689595961117.3e92bc8ff3c25b6361b9004be734ad48.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:12:41,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3e92bc8ff3c25b6361b9004be734ad48 2023-07-17 12:12:41,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3e92bc8ff3c25b6361b9004be734ad48 2023-07-17 12:12:41,543 INFO [StoreOpener-3e92bc8ff3c25b6361b9004be734ad48-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3e92bc8ff3c25b6361b9004be734ad48 2023-07-17 12:12:41,544 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689595961117.7a74d5f0eeeb2ef6e6904242e62acc1d. 2023-07-17 12:12:41,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7a74d5f0eeeb2ef6e6904242e62acc1d, NAME => 'testtb-testEmptyExportFileSystemState,1,1689595961117.7a74d5f0eeeb2ef6e6904242e62acc1d.', STARTKEY => '1', ENDKEY => ''} 2023-07-17 12:12:41,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689595961117.7a74d5f0eeeb2ef6e6904242e62acc1d. service=AccessControlService 2023-07-17 12:12:41,545 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 12:12:41,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 7a74d5f0eeeb2ef6e6904242e62acc1d 2023-07-17 12:12:41,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689595961117.7a74d5f0eeeb2ef6e6904242e62acc1d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:12:41,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7a74d5f0eeeb2ef6e6904242e62acc1d 2023-07-17 12:12:41,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7a74d5f0eeeb2ef6e6904242e62acc1d 2023-07-17 12:12:41,548 INFO [StoreOpener-7a74d5f0eeeb2ef6e6904242e62acc1d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7a74d5f0eeeb2ef6e6904242e62acc1d 2023-07-17 12:12:41,550 DEBUG [StoreOpener-7a74d5f0eeeb2ef6e6904242e62acc1d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testEmptyExportFileSystemState/7a74d5f0eeeb2ef6e6904242e62acc1d/cf 2023-07-17 12:12:41,550 DEBUG [StoreOpener-7a74d5f0eeeb2ef6e6904242e62acc1d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testEmptyExportFileSystemState/7a74d5f0eeeb2ef6e6904242e62acc1d/cf 2023-07-17 12:12:41,551 DEBUG [StoreOpener-3e92bc8ff3c25b6361b9004be734ad48-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testEmptyExportFileSystemState/3e92bc8ff3c25b6361b9004be734ad48/cf 2023-07-17 12:12:41,551 DEBUG [StoreOpener-3e92bc8ff3c25b6361b9004be734ad48-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testEmptyExportFileSystemState/3e92bc8ff3c25b6361b9004be734ad48/cf 2023-07-17 12:12:41,551 INFO [StoreOpener-7a74d5f0eeeb2ef6e6904242e62acc1d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7a74d5f0eeeb2ef6e6904242e62acc1d columnFamilyName cf 2023-07-17 12:12:41,551 INFO [StoreOpener-3e92bc8ff3c25b6361b9004be734ad48-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3e92bc8ff3c25b6361b9004be734ad48 columnFamilyName cf 2023-07-17 12:12:41,552 INFO [StoreOpener-3e92bc8ff3c25b6361b9004be734ad48-1] regionserver.HStore(310): Store=3e92bc8ff3c25b6361b9004be734ad48/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 12:12:41,552 INFO [StoreOpener-7a74d5f0eeeb2ef6e6904242e62acc1d-1] regionserver.HStore(310): Store=7a74d5f0eeeb2ef6e6904242e62acc1d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 12:12:41,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testEmptyExportFileSystemState/7a74d5f0eeeb2ef6e6904242e62acc1d 2023-07-17 12:12:41,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testEmptyExportFileSystemState/3e92bc8ff3c25b6361b9004be734ad48 2023-07-17 12:12:41,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testEmptyExportFileSystemState/7a74d5f0eeeb2ef6e6904242e62acc1d 2023-07-17 12:12:41,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testEmptyExportFileSystemState/3e92bc8ff3c25b6361b9004be734ad48 2023-07-17 12:12:41,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3e92bc8ff3c25b6361b9004be734ad48 2023-07-17 12:12:41,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7a74d5f0eeeb2ef6e6904242e62acc1d 2023-07-17 12:12:41,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testEmptyExportFileSystemState/3e92bc8ff3c25b6361b9004be734ad48/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 12:12:41,562 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3e92bc8ff3c25b6361b9004be734ad48; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62511581, jitterRate=-0.06850485503673553}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 12:12:41,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3e92bc8ff3c25b6361b9004be734ad48: 2023-07-17 12:12:41,564 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689595961117.3e92bc8ff3c25b6361b9004be734ad48., pid=93, masterSystemTime=1689595961521 2023-07-17 12:12:41,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689595961117.3e92bc8ff3c25b6361b9004be734ad48. 2023-07-17 12:12:41,566 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689595961117.3e92bc8ff3c25b6361b9004be734ad48. 2023-07-17 12:12:41,566 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=3e92bc8ff3c25b6361b9004be734ad48, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:41,567 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689595961117.3e92bc8ff3c25b6361b9004be734ad48.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689595961566"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689595961566"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689595961566"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689595961566"}]},"ts":"1689595961566"} 2023-07-17 12:12:41,571 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-17 12:12:41,571 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 3e92bc8ff3c25b6361b9004be734ad48, server=jenkins-hbase4.apache.org,34107,1689595859757 in 199 msec 2023-07-17 12:12:41,573 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3e92bc8ff3c25b6361b9004be734ad48, ASSIGN in 360 msec 2023-07-17 12:12:41,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testEmptyExportFileSystemState/7a74d5f0eeeb2ef6e6904242e62acc1d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 12:12:41,584 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7a74d5f0eeeb2ef6e6904242e62acc1d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67361989, jitterRate=0.003771856427192688}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 12:12:41,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7a74d5f0eeeb2ef6e6904242e62acc1d: 2023-07-17 12:12:41,585 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689595961117.7a74d5f0eeeb2ef6e6904242e62acc1d., pid=94, masterSystemTime=1689595961523 2023-07-17 12:12:41,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689595961117.7a74d5f0eeeb2ef6e6904242e62acc1d. 2023-07-17 12:12:41,587 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689595961117.7a74d5f0eeeb2ef6e6904242e62acc1d. 2023-07-17 12:12:41,588 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=7a74d5f0eeeb2ef6e6904242e62acc1d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:41,588 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689595961117.7a74d5f0eeeb2ef6e6904242e62acc1d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689595961588"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689595961588"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689595961588"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689595961588"}]},"ts":"1689595961588"} 2023-07-17 12:12:41,591 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-17 12:12:41,592 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 7a74d5f0eeeb2ef6e6904242e62acc1d, server=jenkins-hbase4.apache.org,44163,1689595859880 in 220 msec 2023-07-17 12:12:41,594 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-17 12:12:41,594 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7a74d5f0eeeb2ef6e6904242e62acc1d, ASSIGN in 381 msec 2023-07-17 12:12:41,595 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 12:12:41,595 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595961595"}]},"ts":"1689595961595"} 2023-07-17 12:12:41,596 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-17 12:12:41,600 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 12:12:41,600 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-17 12:12:41,602 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44163] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-17 12:12:41,603 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:41,603 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:41,603 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:41,603 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:41,605 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 12:12:41,605 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 12:12:41,605 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 12:12:41,605 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 12:12:41,606 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 487 msec 2023-07-17 12:12:41,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-17 12:12:41,727 INFO [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-17 12:12:41,728 DEBUG [Listener at jenkins-hbase4.apache.org/42275] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-17 12:12:41,728 INFO [Listener at jenkins-hbase4.apache.org/42275] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 12:12:41,732 INFO [Listener at jenkins-hbase4.apache.org/42275] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-17 12:12:41,732 INFO [Listener at jenkins-hbase4.apache.org/42275] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 12:12:41,732 INFO [Listener at jenkins-hbase4.apache.org/42275] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-17 12:12:41,736 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 12:12:41,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689595961736 (current time:1689595961736). 2023-07-17 12:12:41,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 12:12:41,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(139): Connect 0x749e478e to 127.0.0.1:60075 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:12:41,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@226669f0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:12:41,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:12:41,752 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55000, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:12:41,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x749e478e to 127.0.0.1:60075 2023-07-17 12:12:41,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:12:41,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(139): Connect 0x6c2d3ee7 to 127.0.0.1:60075 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:12:41,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a09a6db, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:12:41,781 DEBUG [hconnection-0x7bb17b83-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:12:41,785 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55010, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:12:41,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:12:41,791 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56044, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:12:41,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6c2d3ee7 to 127.0.0.1:60075 2023-07-17 12:12:41,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:12:41,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-17 12:12:41,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 12:12:41,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 12:12:41,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-17 12:12:41,803 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-17 12:12:41,804 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689596561804 2023-07-17 12:12:41,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 12:12:41,805 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-17 12:12:41,808 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-17 12:12:41,809 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-17 12:12:41,810 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 12:12:41,810 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 12:12:41,810 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 14 msec 2023-07-17 12:12:41,815 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-17 12:12:41,815 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689596561815 2023-07-17 12:12:41,848 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:41,848 INFO [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-17 12:12:41,848 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:41,850 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-17 12:12:41,850 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-17 12:12:41,851 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:41,851 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:41,859 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:41,859 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:41,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:41,859 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:41,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:41,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:41,859 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:41,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:41,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:41,859 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:41,859 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:41,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:41,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:41,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:41,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:41,860 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:41,860 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:41,860 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 12:12:41,861 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:41,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-17 12:12:41,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:41,861 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-17 12:12:41,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-17 12:12:41,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:41,861 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:41,861 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-17 12:12:41,862 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:41,862 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-17 12:12:41,862 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:41,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-17 12:12:41,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:41,869 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-17 12:12:41,871 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:41,871 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-17 12:12:41,871 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:41,873 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-17 12:12:41,873 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-17 12:12:41,873 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:41,873 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-17 12:12:41,873 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-17 12:12:41,873 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37767,1689595859826' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-17 12:12:41,873 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-17 12:12:41,873 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:41,873 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34107,1689595859757' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-17 12:12:41,875 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-17 12:12:41,875 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-17 12:12:41,875 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44163,1689595859880' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-17 12:12:41,877 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:41,877 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:41,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:41,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:41,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:41,877 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:41,878 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:41,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:41,878 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:41,879 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:12:41,878 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:41,879 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:12:41,878 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:41,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:41,879 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:41,879 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:12:41,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:41,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:41,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:41,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:41,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:41,885 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34107,1689595859757' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-17 12:12:41,885 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2757e707[Count = 1] remaining members to acquire global barrier 2023-07-17 12:12:41,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:41,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:41,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:41,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:41,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:41,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:41,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:41,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:41,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:41,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:41,892 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44163,1689595859880' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-17 12:12:41,892 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2757e707[Count = 0] remaining members to acquire global barrier 2023-07-17 12:12:41,892 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-17 12:12:41,892 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:41,894 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:41,894 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:41,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:41,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:41,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:41,894 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:41,894 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-17 12:12:41,894 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:41,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:41,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:41,895 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-17 12:12:41,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:41,895 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-17 12:12:41,895 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-17 12:12:41,895 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:41,895 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 12:12:41,895 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37767,1689595859826' in zk 2023-07-17 12:12:41,898 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-17 12:12:41,898 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:41,898 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-17 12:12:41,901 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:12:41,920 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:12:41,920 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689595961117.7a74d5f0eeeb2ef6e6904242e62acc1d. 2023-07-17 12:12:41,920 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689595961117.3e92bc8ff3c25b6361b9004be734ad48. 2023-07-17 12:12:41,919 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:12:41,920 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:12:41,910 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:12:41,920 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689595961117.3e92bc8ff3c25b6361b9004be734ad48. started... 2023-07-17 12:12:41,920 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689595961117.7a74d5f0eeeb2ef6e6904242e62acc1d. started... 2023-07-17 12:12:41,923 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3e92bc8ff3c25b6361b9004be734ad48: 2023-07-17 12:12:41,923 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689595961117.3e92bc8ff3c25b6361b9004be734ad48.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:41,923 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:12:41,923 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 12:12:41,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 12:12:41,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:12:41,924 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 12:12:41,923 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7a74d5f0eeeb2ef6e6904242e62acc1d: 2023-07-17 12:12:41,926 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689595961117.7a74d5f0eeeb2ef6e6904242e62acc1d.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:41,926 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:12:41,926 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 12:12:42,001 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689595961117.7a74d5f0eeeb2ef6e6904242e62acc1d. completed. 2023-07-17 12:12:42,001 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689595961117.7a74d5f0eeeb2ef6e6904242e62acc1d. 2023-07-17 12:12:42,001 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:12:42,001 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:12:42,001 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:42,001 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-17 12:12:42,001 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44163,1689595859880' in zk 2023-07-17 12:12:42,003 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689595961117.3e92bc8ff3c25b6361b9004be734ad48. completed. 2023-07-17 12:12:42,003 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689595961117.3e92bc8ff3c25b6361b9004be734ad48. 2023-07-17 12:12:42,003 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:12:42,003 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:12:42,003 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:42,003 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-17 12:12:42,003 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34107,1689595859757' in zk 2023-07-17 12:12:42,004 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:42,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:42,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:42,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:42,005 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-17 12:12:42,005 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:42,005 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-17 12:12:42,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:42,013 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:42,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:42,013 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-17 12:12:42,013 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:42,013 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-17 12:12:42,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:42,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:42,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:42,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:42,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:42,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:42,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:42,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,44163,1689595859880': 2023-07-17 12:12:42,019 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44163,1689595859880' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-17 12:12:42,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:42,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:42,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:42,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:42,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:42,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:42,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:42,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:42,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:42,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:42,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:42,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:42,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,34107,1689595859757': 2023-07-17 12:12:42,023 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34107,1689595859757' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-17 12:12:42,023 INFO [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-17 12:12:42,023 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 12:12:42,024 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 12:12:42,024 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,024 INFO [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 12:12:42,026 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,026 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:42,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,026 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,026 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:42,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:42,026 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:42,027 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,027 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:42,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:42,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:42,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:42,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:42,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:42,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:42,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:42,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,028 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:42,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,028 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:42,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:42,029 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:42,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:42,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:42,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:42,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:42,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,031 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:42,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:42,031 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:42,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:42,034 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:42,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:42,041 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:42,041 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:42,041 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:42,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:42,041 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:42,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:42,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:42,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:42,042 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:42,042 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:42,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:42,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:42,042 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:42,042 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,042 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:42,042 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:42,042 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,042 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,042 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:42,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:42,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:42,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:42,047 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,042 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:42,042 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:42,047 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:42,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:42,047 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:42,050 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:42,050 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,050 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,108 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,124 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:12:42,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 12:12:42,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:12:42,125 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 12:12:42,141 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-17 12:12:42,141 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,141 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,141 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689595961805Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689595962042 (+237 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689595962042Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689595962058 (+16 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689595962099 (+41 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689595962141 (+42 ms) 2023-07-17 12:12:42,145 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-17 12:12:42,147 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 339 msec 2023-07-17 12:12:42,425 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:12:42,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 12:12:42,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 12:12:42,461 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44163] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689595961117.7a74d5f0eeeb2ef6e6904242e62acc1d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 12:12:42,464 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34107] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689595961117.3e92bc8ff3c25b6361b9004be734ad48. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 12:12:42,472 DEBUG [Listener at jenkins-hbase4.apache.org/42275] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-17 12:12:42,473 DEBUG [Listener at jenkins-hbase4.apache.org/42275] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689595961117.3e92bc8ff3c25b6361b9004be734ad48. 2023-07-17 12:12:42,473 INFO [Listener at jenkins-hbase4.apache.org/42275] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 12:12:42,487 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 12:12:42,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689595962487 (current time:1689595962487). 2023-07-17 12:12:42,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 12:12:42,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(139): Connect 0x5be709fb to 127.0.0.1:60075 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:12:42,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b7a1c67, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:12:42,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:12:42,502 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55022, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:12:42,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5be709fb to 127.0.0.1:60075 2023-07-17 12:12:42,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:12:42,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(139): Connect 0x50c02966 to 127.0.0.1:60075 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:12:42,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@338b4a54, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:12:42,614 DEBUG [hconnection-0x48e9f166-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:12:42,616 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55024, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:12:42,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:12:42,631 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56054, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:12:42,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x50c02966 to 127.0.0.1:60075 2023-07-17 12:12:42,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:12:42,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-17 12:12:42,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 12:12:42,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 12:12:42,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-17 12:12:42,642 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-17 12:12:42,643 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689596562643 2023-07-17 12:12:42,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 12:12:42,651 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-17 12:12:42,651 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 12:12:42,651 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 12:12:42,661 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-17 12:12:42,661 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-17 12:12:42,663 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 22 msec 2023-07-17 12:12:42,664 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-17 12:12:42,671 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689596562671 2023-07-17 12:12:42,705 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,705 INFO [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-17 12:12:42,705 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:42,707 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-17 12:12:42,707 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-17 12:12:42,708 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,708 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,710 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:42,710 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:42,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:42,710 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:42,710 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:42,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:42,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:42,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:42,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:42,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:42,711 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:42,711 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:42,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,711 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:42,711 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 12:12:42,712 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,712 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,712 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-17 12:12:42,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,712 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-17 12:12:42,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-17 12:12:42,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-17 12:12:42,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,713 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-17 12:12:42,713 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-17 12:12:42,713 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,713 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,713 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-17 12:12:42,713 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-17 12:12:42,713 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:42,713 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:42,715 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-17 12:12:42,715 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,715 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-17 12:12:42,715 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-17 12:12:42,715 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34107,1689595859757' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-17 12:12:42,715 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-17 12:12:42,715 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-17 12:12:42,715 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:42,715 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37767,1689595859826' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-17 12:12:42,719 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-17 12:12:42,720 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-17 12:12:42,720 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44163,1689595859880' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-17 12:12:42,722 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,722 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:42,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:42,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:42,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:42,722 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,724 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:42,724 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,724 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:12:42,725 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,725 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:12:42,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:42,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:42,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:42,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:42,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:42,726 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34107,1689595859757' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-17 12:12:42,726 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@658ca244[Count = 1] remaining members to acquire global barrier 2023-07-17 12:12:42,730 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:42,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:42,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:42,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:42,730 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,730 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:12:42,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:42,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:42,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:42,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:42,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:42,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:42,732 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44163,1689595859880' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-17 12:12:42,733 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@658ca244[Count = 0] remaining members to acquire global barrier 2023-07-17 12:12:42,733 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-17 12:12:42,733 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,738 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,738 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,738 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,739 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-17 12:12:42,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,739 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-17 12:12:42,739 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-17 12:12:42,739 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-17 12:12:42,739 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37767,1689595859826' in zk 2023-07-17 12:12:42,741 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-17 12:12:42,741 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:42,741 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-17 12:12:42,741 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:42,742 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:42,742 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 12:12:42,746 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:12:42,747 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:12:42,752 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:12:42,752 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689595961117.3e92bc8ff3c25b6361b9004be734ad48. 2023-07-17 12:12:42,752 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689595961117.7a74d5f0eeeb2ef6e6904242e62acc1d. 2023-07-17 12:12:42,752 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689595961117.3e92bc8ff3c25b6361b9004be734ad48. started... 2023-07-17 12:12:42,752 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689595961117.7a74d5f0eeeb2ef6e6904242e62acc1d. started... 2023-07-17 12:12:42,752 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:12:42,752 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:12:42,752 INFO [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3e92bc8ff3c25b6361b9004be734ad48 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-17 12:12:42,752 INFO [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7a74d5f0eeeb2ef6e6904242e62acc1d 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-17 12:12:42,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 12:12:42,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:12:42,754 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 12:12:42,787 INFO [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testEmptyExportFileSystemState/7a74d5f0eeeb2ef6e6904242e62acc1d/.tmp/cf/ea505d98af0646e8af718c45b942a5c9 2023-07-17 12:12:42,791 INFO [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testEmptyExportFileSystemState/3e92bc8ff3c25b6361b9004be734ad48/.tmp/cf/2377367df28d4f02b0a6b2df5ebcb1b9 2023-07-17 12:12:42,807 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testEmptyExportFileSystemState/7a74d5f0eeeb2ef6e6904242e62acc1d/.tmp/cf/ea505d98af0646e8af718c45b942a5c9 as hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testEmptyExportFileSystemState/7a74d5f0eeeb2ef6e6904242e62acc1d/cf/ea505d98af0646e8af718c45b942a5c9 2023-07-17 12:12:42,809 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testEmptyExportFileSystemState/3e92bc8ff3c25b6361b9004be734ad48/.tmp/cf/2377367df28d4f02b0a6b2df5ebcb1b9 as hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testEmptyExportFileSystemState/3e92bc8ff3c25b6361b9004be734ad48/cf/2377367df28d4f02b0a6b2df5ebcb1b9 2023-07-17 12:12:42,818 INFO [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testEmptyExportFileSystemState/7a74d5f0eeeb2ef6e6904242e62acc1d/cf/ea505d98af0646e8af718c45b942a5c9, entries=47, sequenceid=6, filesize=8.0 K 2023-07-17 12:12:42,819 INFO [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 7a74d5f0eeeb2ef6e6904242e62acc1d in 67ms, sequenceid=6, compaction requested=false 2023-07-17 12:12:42,819 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-17 12:12:42,820 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7a74d5f0eeeb2ef6e6904242e62acc1d: 2023-07-17 12:12:42,820 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689595961117.7a74d5f0eeeb2ef6e6904242e62acc1d.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,822 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:12:42,822 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testEmptyExportFileSystemState/7a74d5f0eeeb2ef6e6904242e62acc1d/cf/ea505d98af0646e8af718c45b942a5c9] hfiles 2023-07-17 12:12:42,822 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testEmptyExportFileSystemState/7a74d5f0eeeb2ef6e6904242e62acc1d/cf/ea505d98af0646e8af718c45b942a5c9 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,842 INFO [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testEmptyExportFileSystemState/3e92bc8ff3c25b6361b9004be734ad48/cf/2377367df28d4f02b0a6b2df5ebcb1b9, entries=3, sequenceid=6, filesize=5.0 K 2023-07-17 12:12:42,845 INFO [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 3e92bc8ff3c25b6361b9004be734ad48 in 93ms, sequenceid=6, compaction requested=false 2023-07-17 12:12:42,869 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3e92bc8ff3c25b6361b9004be734ad48: 2023-07-17 12:12:42,869 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689595961117.3e92bc8ff3c25b6361b9004be734ad48.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,869 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:12:42,869 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testEmptyExportFileSystemState/3e92bc8ff3c25b6361b9004be734ad48/cf/2377367df28d4f02b0a6b2df5ebcb1b9] hfiles 2023-07-17 12:12:42,869 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testEmptyExportFileSystemState/3e92bc8ff3c25b6361b9004be734ad48/cf/2377367df28d4f02b0a6b2df5ebcb1b9 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,903 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689595961117.7a74d5f0eeeb2ef6e6904242e62acc1d. completed. 2023-07-17 12:12:42,903 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689595961117.7a74d5f0eeeb2ef6e6904242e62acc1d. 2023-07-17 12:12:42,903 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:12:42,903 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:12:42,903 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:42,903 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-17 12:12:42,903 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44163,1689595859880' in zk 2023-07-17 12:12:42,905 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-17 12:12:42,906 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:42,906 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-17 12:12:42,906 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:42,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:42,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:42,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:42,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:42,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:42,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:42,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:42,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:42,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:42,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:42,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:42,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,44163,1689595859880': 2023-07-17 12:12:42,914 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44163,1689595859880' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-17 12:12:42,937 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689595961117.3e92bc8ff3c25b6361b9004be734ad48. completed. 2023-07-17 12:12:42,937 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689595961117.3e92bc8ff3c25b6361b9004be734ad48. 2023-07-17 12:12:42,937 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:12:42,938 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:12:42,938 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:42,938 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-17 12:12:42,938 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34107,1689595859757' in zk 2023-07-17 12:12:42,940 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:42,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:42,940 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-17 12:12:42,940 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:42,940 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-17 12:12:42,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:42,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:42,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:42,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:42,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:42,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:42,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:42,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:42,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:42,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:42,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:42,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,34107,1689595859757': 2023-07-17 12:12:42,946 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34107,1689595859757' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-17 12:12:42,946 INFO [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-17 12:12:42,946 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 12:12:42,946 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 12:12:42,946 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,946 INFO [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 12:12:42,951 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,951 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:42,951 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,951 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:42,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,951 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,951 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:42,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:42,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:42,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:42,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:42,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:42,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:42,952 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:42,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:42,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:42,954 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:42,954 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:12:42,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,954 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:42,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:42,955 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:42,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 12:12:42,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:12:42,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,955 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 12:12:42,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:42,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:42,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:42,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:42,957 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:42,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,957 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:42,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:42,958 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:42,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:42,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:42,961 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:42,961 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:42,961 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:42,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:42,961 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:42,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:42,961 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:42,962 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:42,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:42,961 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:42,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:42,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:42,962 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,962 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:42,962 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:42,962 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,962 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:42,962 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,962 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:42,962 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:42,962 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:42,962 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:42,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:42,966 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:42,967 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,967 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:42,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:42,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:42,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:42,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:42,969 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,056 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,138 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-17 12:12:43,138 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,138 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,138 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689595962651Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689595962967 (+316 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689595962967Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689595962997 (+30 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689595963048 (+51 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689595963138 (+90 ms) 2023-07-17 12:12:43,145 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-17 12:12:43,147 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 487 msec 2023-07-17 12:12:43,255 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:12:43,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 12:12:43,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 12:12:43,257 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595963257 2023-07-17 12:12:43,257 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40781, tgtDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595963257, rawTgtDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595963257, srcFsUri=hdfs://localhost:40781, srcDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c 2023-07-17 12:12:43,288 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40781, inputRoot=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c 2023-07-17 12:12:43,288 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1184146786_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595963257, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595963257/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,288 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40781, inputRoot=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c, snapshotDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-17 12:12:43,295 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595963257/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:43,327 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:43,328 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:43,328 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:43,328 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:43,329 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:43,329 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:43,329 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:43,414 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/hadoop-7349291704685499631.jar 2023-07-17 12:12:43,415 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:43,415 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:43,416 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:43,416 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:43,417 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:43,417 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:43,418 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-17 12:12:43,419 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-17 12:12:43,419 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-17 12:12:43,420 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-17 12:12:43,420 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-17 12:12:43,421 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-17 12:12:43,421 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-17 12:12:43,422 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-17 12:12:43,422 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-17 12:12:43,423 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-17 12:12:43,424 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:12:43,424 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:12:43,425 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 12:12:43,425 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:12:43,425 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:12:43,426 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 12:12:43,427 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 12:12:44,187 WARN [Listener at jenkins-hbase4.apache.org/42275] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-17 12:12:44,190 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-17 12:12:44,364 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 12:12:44,364 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 12:12:44,367 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867780_0005_000001 (auth:SIMPLE) 2023-07-17 12:12:45,122 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867780_0006_000001 (auth:SIMPLE) 2023-07-17 12:12:45,980 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 12:12:51,674 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867780_0006_000001 (auth:SIMPLE) 2023-07-17 12:12:54,582 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-17 12:12:54,585 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-17 12:12:54,592 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:54,592 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-17 12:12:54,592 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-17 12:12:54,592 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-269744684_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:54,593 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(367): hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-17 12:12:54,593 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(367): hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-17 12:12:54,593 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-269744684_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595963257/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595963257/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:54,593 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(367): hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595963257/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-17 12:12:54,593 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(367): hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595963257/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-17 12:12:54,598 INFO [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-17 12:12:54,598 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-17 12:12:54,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 12:12:54,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-17 12:12:54,603 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595974602"}]},"ts":"1689595974602"} 2023-07-17 12:12:54,604 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-17 12:12:54,606 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-17 12:12:54,606 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3e92bc8ff3c25b6361b9004be734ad48, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7a74d5f0eeeb2ef6e6904242e62acc1d, UNASSIGN}] 2023-07-17 12:12:54,608 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3e92bc8ff3c25b6361b9004be734ad48, UNASSIGN 2023-07-17 12:12:54,608 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7a74d5f0eeeb2ef6e6904242e62acc1d, UNASSIGN 2023-07-17 12:12:54,609 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=3e92bc8ff3c25b6361b9004be734ad48, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:54,609 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=7a74d5f0eeeb2ef6e6904242e62acc1d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:54,609 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689595961117.3e92bc8ff3c25b6361b9004be734ad48.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689595974609"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595974609"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595974609"}]},"ts":"1689595974609"} 2023-07-17 12:12:54,609 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689595961117.7a74d5f0eeeb2ef6e6904242e62acc1d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689595974609"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595974609"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595974609"}]},"ts":"1689595974609"} 2023-07-17 12:12:54,610 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 3e92bc8ff3c25b6361b9004be734ad48, server=jenkins-hbase4.apache.org,34107,1689595859757}] 2023-07-17 12:12:54,611 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 7a74d5f0eeeb2ef6e6904242e62acc1d, server=jenkins-hbase4.apache.org,44163,1689595859880}] 2023-07-17 12:12:54,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-17 12:12:54,762 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3e92bc8ff3c25b6361b9004be734ad48 2023-07-17 12:12:54,762 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3e92bc8ff3c25b6361b9004be734ad48, disabling compactions & flushes 2023-07-17 12:12:54,762 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689595961117.3e92bc8ff3c25b6361b9004be734ad48. 2023-07-17 12:12:54,762 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689595961117.3e92bc8ff3c25b6361b9004be734ad48. 2023-07-17 12:12:54,762 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689595961117.3e92bc8ff3c25b6361b9004be734ad48. after waiting 0 ms 2023-07-17 12:12:54,762 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689595961117.3e92bc8ff3c25b6361b9004be734ad48. 2023-07-17 12:12:54,766 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7a74d5f0eeeb2ef6e6904242e62acc1d 2023-07-17 12:12:54,766 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7a74d5f0eeeb2ef6e6904242e62acc1d, disabling compactions & flushes 2023-07-17 12:12:54,766 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689595961117.7a74d5f0eeeb2ef6e6904242e62acc1d. 2023-07-17 12:12:54,766 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689595961117.7a74d5f0eeeb2ef6e6904242e62acc1d. 2023-07-17 12:12:54,766 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689595961117.7a74d5f0eeeb2ef6e6904242e62acc1d. after waiting 0 ms 2023-07-17 12:12:54,766 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689595961117.7a74d5f0eeeb2ef6e6904242e62acc1d. 2023-07-17 12:12:54,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testEmptyExportFileSystemState/3e92bc8ff3c25b6361b9004be734ad48/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 12:12:54,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testEmptyExportFileSystemState/7a74d5f0eeeb2ef6e6904242e62acc1d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 12:12:54,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:12:54,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:12:54,776 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689595961117.3e92bc8ff3c25b6361b9004be734ad48. 2023-07-17 12:12:54,777 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689595961117.7a74d5f0eeeb2ef6e6904242e62acc1d. 2023-07-17 12:12:54,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3e92bc8ff3c25b6361b9004be734ad48: 2023-07-17 12:12:54,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7a74d5f0eeeb2ef6e6904242e62acc1d: 2023-07-17 12:12:54,779 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3e92bc8ff3c25b6361b9004be734ad48 2023-07-17 12:12:54,779 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=3e92bc8ff3c25b6361b9004be734ad48, regionState=CLOSED 2023-07-17 12:12:54,779 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7a74d5f0eeeb2ef6e6904242e62acc1d 2023-07-17 12:12:54,779 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689595961117.3e92bc8ff3c25b6361b9004be734ad48.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689595974779"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595974779"}]},"ts":"1689595974779"} 2023-07-17 12:12:54,779 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=7a74d5f0eeeb2ef6e6904242e62acc1d, regionState=CLOSED 2023-07-17 12:12:54,780 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689595961117.7a74d5f0eeeb2ef6e6904242e62acc1d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689595974779"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595974779"}]},"ts":"1689595974779"} 2023-07-17 12:12:54,782 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-17 12:12:54,782 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 3e92bc8ff3c25b6361b9004be734ad48, server=jenkins-hbase4.apache.org,34107,1689595859757 in 170 msec 2023-07-17 12:12:54,783 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3e92bc8ff3c25b6361b9004be734ad48, UNASSIGN in 176 msec 2023-07-17 12:12:54,788 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-17 12:12:54,788 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 7a74d5f0eeeb2ef6e6904242e62acc1d, server=jenkins-hbase4.apache.org,44163,1689595859880 in 176 msec 2023-07-17 12:12:54,789 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-17 12:12:54,790 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7a74d5f0eeeb2ef6e6904242e62acc1d, UNASSIGN in 182 msec 2023-07-17 12:12:54,790 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595974790"}]},"ts":"1689595974790"} 2023-07-17 12:12:54,791 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-17 12:12:54,793 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-17 12:12:54,794 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 194 msec 2023-07-17 12:12:54,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-17 12:12:54,905 INFO [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-17 12:12:54,906 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-17 12:12:54,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 12:12:54,911 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 12:12:54,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-17 12:12:54,912 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 12:12:54,914 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44163] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-17 12:12:54,917 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 12:12:54,917 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 12:12:54,917 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 12:12:54,917 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 12:12:54,918 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-17 12:12:54,918 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-17 12:12:54,918 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-17 12:12:54,918 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-17 12:12:54,918 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testEmptyExportFileSystemState/7a74d5f0eeeb2ef6e6904242e62acc1d 2023-07-17 12:12:54,918 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testEmptyExportFileSystemState/3e92bc8ff3c25b6361b9004be734ad48 2023-07-17 12:12:54,919 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 12:12:54,919 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 12:12:54,919 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:54,919 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:54,919 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 12:12:54,919 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 12:12:54,919 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:54,919 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:54,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-17 12:12:54,921 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testEmptyExportFileSystemState/7a74d5f0eeeb2ef6e6904242e62acc1d/cf, FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testEmptyExportFileSystemState/7a74d5f0eeeb2ef6e6904242e62acc1d/recovered.edits] 2023-07-17 12:12:54,921 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testEmptyExportFileSystemState/3e92bc8ff3c25b6361b9004be734ad48/cf, FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testEmptyExportFileSystemState/3e92bc8ff3c25b6361b9004be734ad48/recovered.edits] 2023-07-17 12:12:54,926 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testEmptyExportFileSystemState/3e92bc8ff3c25b6361b9004be734ad48/cf/2377367df28d4f02b0a6b2df5ebcb1b9 to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/archive/data/default/testtb-testEmptyExportFileSystemState/3e92bc8ff3c25b6361b9004be734ad48/cf/2377367df28d4f02b0a6b2df5ebcb1b9 2023-07-17 12:12:54,926 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testEmptyExportFileSystemState/7a74d5f0eeeb2ef6e6904242e62acc1d/cf/ea505d98af0646e8af718c45b942a5c9 to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/archive/data/default/testtb-testEmptyExportFileSystemState/7a74d5f0eeeb2ef6e6904242e62acc1d/cf/ea505d98af0646e8af718c45b942a5c9 2023-07-17 12:12:54,929 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testEmptyExportFileSystemState/3e92bc8ff3c25b6361b9004be734ad48/recovered.edits/9.seqid to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/archive/data/default/testtb-testEmptyExportFileSystemState/3e92bc8ff3c25b6361b9004be734ad48/recovered.edits/9.seqid 2023-07-17 12:12:54,929 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testEmptyExportFileSystemState/7a74d5f0eeeb2ef6e6904242e62acc1d/recovered.edits/9.seqid to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/archive/data/default/testtb-testEmptyExportFileSystemState/7a74d5f0eeeb2ef6e6904242e62acc1d/recovered.edits/9.seqid 2023-07-17 12:12:54,930 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testEmptyExportFileSystemState/3e92bc8ff3c25b6361b9004be734ad48 2023-07-17 12:12:54,930 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testEmptyExportFileSystemState/7a74d5f0eeeb2ef6e6904242e62acc1d 2023-07-17 12:12:54,930 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-17 12:12:54,932 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 12:12:54,934 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-17 12:12:54,937 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-17 12:12:54,938 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 12:12:54,938 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-17 12:12:54,938 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689595961117.3e92bc8ff3c25b6361b9004be734ad48.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689595974938"}]},"ts":"9223372036854775807"} 2023-07-17 12:12:54,938 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689595961117.7a74d5f0eeeb2ef6e6904242e62acc1d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689595974938"}]},"ts":"9223372036854775807"} 2023-07-17 12:12:54,939 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-17 12:12:54,940 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3e92bc8ff3c25b6361b9004be734ad48, NAME => 'testtb-testEmptyExportFileSystemState,,1689595961117.3e92bc8ff3c25b6361b9004be734ad48.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 7a74d5f0eeeb2ef6e6904242e62acc1d, NAME => 'testtb-testEmptyExportFileSystemState,1,1689595961117.7a74d5f0eeeb2ef6e6904242e62acc1d.', STARTKEY => '1', ENDKEY => ''}] 2023-07-17 12:12:54,940 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-17 12:12:54,940 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689595974940"}]},"ts":"9223372036854775807"} 2023-07-17 12:12:54,948 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-17 12:12:54,950 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 12:12:54,951 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 44 msec 2023-07-17 12:12:55,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-17 12:12:55,022 INFO [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-17 12:12:55,035 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-17 12:12:55,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:55,039 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-17 12:12:55,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-17 12:12:55,071 INFO [Listener at jenkins-hbase4.apache.org/42275] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=762 (was 761) Potentially hanging thread: hconnection-0x24b8e848-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-269744684_17 at /127.0.0.1:59270 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-269744684_17 at /127.0.0.1:38858 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (905985230) connection to jenkins-hbase4.apache.org/172.31.14.131:38207 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (905985230) connection to jenkins-hbase4.apache.org/172.31.14.131:42883 from appattempt_1689595867780_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Thread-4705 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x24b8e848-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x24b8e848-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-269744684_17 at /127.0.0.1:57252 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x24b8e848-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1998205713_1 at /127.0.0.1:59250 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1998205713_1 at /127.0.0.1:57230 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=914 (was 914), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=688 (was 560) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 183), AvailableMemoryMB=1641 (was 2360) 2023-07-17 12:12:55,071 WARN [Listener at jenkins-hbase4.apache.org/42275] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-17 12:12:55,097 INFO [Listener at jenkins-hbase4.apache.org/42275] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=762, OpenFileDescriptor=914, MaxFileDescriptor=60000, SystemLoadAverage=688, ProcessCount=183, AvailableMemoryMB=1639 2023-07-17 12:12:55,097 WARN [Listener at jenkins-hbase4.apache.org/42275] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-17 12:12:55,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-17 12:12:55,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,103 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 12:12:55,103 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-17 12:12:55,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-17 12:12:55,105 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 12:12:55,108 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/232a3ebc3c50e84ef5e9592cf4a6ceb7 2023-07-17 12:12:55,108 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/10e6d7e318c4395ec3e88dbe8bf37d63 2023-07-17 12:12:55,109 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/232a3ebc3c50e84ef5e9592cf4a6ceb7 empty. 2023-07-17 12:12:55,109 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/10e6d7e318c4395ec3e88dbe8bf37d63 empty. 2023-07-17 12:12:55,110 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/232a3ebc3c50e84ef5e9592cf4a6ceb7 2023-07-17 12:12:55,110 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/10e6d7e318c4395ec3e88dbe8bf37d63 2023-07-17 12:12:55,110 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-17 12:12:55,125 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-17 12:12:55,127 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 232a3ebc3c50e84ef5e9592cf4a6ceb7, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689595975098.232a3ebc3c50e84ef5e9592cf4a6ceb7.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp 2023-07-17 12:12:55,127 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 10e6d7e318c4395ec3e88dbe8bf37d63, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689595975098.10e6d7e318c4395ec3e88dbe8bf37d63.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp 2023-07-17 12:12:55,157 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689595975098.232a3ebc3c50e84ef5e9592cf4a6ceb7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:12:55,157 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 232a3ebc3c50e84ef5e9592cf4a6ceb7, disabling compactions & flushes 2023-07-17 12:12:55,157 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689595975098.232a3ebc3c50e84ef5e9592cf4a6ceb7. 2023-07-17 12:12:55,157 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689595975098.232a3ebc3c50e84ef5e9592cf4a6ceb7. 2023-07-17 12:12:55,158 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689595975098.232a3ebc3c50e84ef5e9592cf4a6ceb7. after waiting 0 ms 2023-07-17 12:12:55,158 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689595975098.232a3ebc3c50e84ef5e9592cf4a6ceb7. 2023-07-17 12:12:55,158 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689595975098.232a3ebc3c50e84ef5e9592cf4a6ceb7. 2023-07-17 12:12:55,158 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 232a3ebc3c50e84ef5e9592cf4a6ceb7: 2023-07-17 12:12:55,158 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689595975098.10e6d7e318c4395ec3e88dbe8bf37d63.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:12:55,158 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 10e6d7e318c4395ec3e88dbe8bf37d63, disabling compactions & flushes 2023-07-17 12:12:55,158 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689595975098.10e6d7e318c4395ec3e88dbe8bf37d63. 2023-07-17 12:12:55,158 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689595975098.10e6d7e318c4395ec3e88dbe8bf37d63. 2023-07-17 12:12:55,158 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689595975098.10e6d7e318c4395ec3e88dbe8bf37d63. after waiting 0 ms 2023-07-17 12:12:55,158 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689595975098.10e6d7e318c4395ec3e88dbe8bf37d63. 2023-07-17 12:12:55,158 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689595975098.10e6d7e318c4395ec3e88dbe8bf37d63. 2023-07-17 12:12:55,158 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 10e6d7e318c4395ec3e88dbe8bf37d63: 2023-07-17 12:12:55,162 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 12:12:55,165 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689595975098.232a3ebc3c50e84ef5e9592cf4a6ceb7.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689595975165"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595975165"}]},"ts":"1689595975165"} 2023-07-17 12:12:55,165 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689595975098.10e6d7e318c4395ec3e88dbe8bf37d63.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689595975165"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595975165"}]},"ts":"1689595975165"} 2023-07-17 12:12:55,167 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-17 12:12:55,168 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 12:12:55,168 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595975168"}]},"ts":"1689595975168"} 2023-07-17 12:12:55,169 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-17 12:12:55,181 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 12:12:55,183 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 12:12:55,183 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 12:12:55,183 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 12:12:55,183 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 12:12:55,183 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=232a3ebc3c50e84ef5e9592cf4a6ceb7, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=10e6d7e318c4395ec3e88dbe8bf37d63, ASSIGN}] 2023-07-17 12:12:55,192 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=232a3ebc3c50e84ef5e9592cf4a6ceb7, ASSIGN 2023-07-17 12:12:55,193 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=10e6d7e318c4395ec3e88dbe8bf37d63, ASSIGN 2023-07-17 12:12:55,193 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=10e6d7e318c4395ec3e88dbe8bf37d63, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34107,1689595859757; forceNewPlan=false, retain=false 2023-07-17 12:12:55,194 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=232a3ebc3c50e84ef5e9592cf4a6ceb7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44163,1689595859880; forceNewPlan=false, retain=false 2023-07-17 12:12:55,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-17 12:12:55,344 INFO [jenkins-hbase4:35573] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-17 12:12:55,347 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=232a3ebc3c50e84ef5e9592cf4a6ceb7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:55,347 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=10e6d7e318c4395ec3e88dbe8bf37d63, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:55,347 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689595975098.232a3ebc3c50e84ef5e9592cf4a6ceb7.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689595975347"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595975347"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595975347"}]},"ts":"1689595975347"} 2023-07-17 12:12:55,347 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689595975098.10e6d7e318c4395ec3e88dbe8bf37d63.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689595975347"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595975347"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595975347"}]},"ts":"1689595975347"} 2023-07-17 12:12:55,349 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 232a3ebc3c50e84ef5e9592cf4a6ceb7, server=jenkins-hbase4.apache.org,44163,1689595859880}] 2023-07-17 12:12:55,350 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 10e6d7e318c4395ec3e88dbe8bf37d63, server=jenkins-hbase4.apache.org,34107,1689595859757}] 2023-07-17 12:12:55,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-17 12:12:55,504 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689595975098.232a3ebc3c50e84ef5e9592cf4a6ceb7. 2023-07-17 12:12:55,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 232a3ebc3c50e84ef5e9592cf4a6ceb7, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689595975098.232a3ebc3c50e84ef5e9592cf4a6ceb7.', STARTKEY => '', ENDKEY => '1'} 2023-07-17 12:12:55,504 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689595975098.10e6d7e318c4395ec3e88dbe8bf37d63. 2023-07-17 12:12:55,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689595975098.232a3ebc3c50e84ef5e9592cf4a6ceb7. service=AccessControlService 2023-07-17 12:12:55,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 10e6d7e318c4395ec3e88dbe8bf37d63, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689595975098.10e6d7e318c4395ec3e88dbe8bf37d63.', STARTKEY => '1', ENDKEY => ''} 2023-07-17 12:12:55,505 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 12:12:55,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689595975098.10e6d7e318c4395ec3e88dbe8bf37d63. service=AccessControlService 2023-07-17 12:12:55,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 232a3ebc3c50e84ef5e9592cf4a6ceb7 2023-07-17 12:12:55,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689595975098.232a3ebc3c50e84ef5e9592cf4a6ceb7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:12:55,505 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 12:12:55,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 232a3ebc3c50e84ef5e9592cf4a6ceb7 2023-07-17 12:12:55,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 10e6d7e318c4395ec3e88dbe8bf37d63 2023-07-17 12:12:55,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 232a3ebc3c50e84ef5e9592cf4a6ceb7 2023-07-17 12:12:55,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689595975098.10e6d7e318c4395ec3e88dbe8bf37d63.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 12:12:55,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 10e6d7e318c4395ec3e88dbe8bf37d63 2023-07-17 12:12:55,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 10e6d7e318c4395ec3e88dbe8bf37d63 2023-07-17 12:12:55,507 INFO [StoreOpener-232a3ebc3c50e84ef5e9592cf4a6ceb7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 232a3ebc3c50e84ef5e9592cf4a6ceb7 2023-07-17 12:12:55,507 INFO [StoreOpener-10e6d7e318c4395ec3e88dbe8bf37d63-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 10e6d7e318c4395ec3e88dbe8bf37d63 2023-07-17 12:12:55,508 DEBUG [StoreOpener-10e6d7e318c4395ec3e88dbe8bf37d63-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithSkipTmp/10e6d7e318c4395ec3e88dbe8bf37d63/cf 2023-07-17 12:12:55,508 DEBUG [StoreOpener-10e6d7e318c4395ec3e88dbe8bf37d63-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithSkipTmp/10e6d7e318c4395ec3e88dbe8bf37d63/cf 2023-07-17 12:12:55,508 DEBUG [StoreOpener-232a3ebc3c50e84ef5e9592cf4a6ceb7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithSkipTmp/232a3ebc3c50e84ef5e9592cf4a6ceb7/cf 2023-07-17 12:12:55,509 DEBUG [StoreOpener-232a3ebc3c50e84ef5e9592cf4a6ceb7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithSkipTmp/232a3ebc3c50e84ef5e9592cf4a6ceb7/cf 2023-07-17 12:12:55,509 INFO [StoreOpener-10e6d7e318c4395ec3e88dbe8bf37d63-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 10e6d7e318c4395ec3e88dbe8bf37d63 columnFamilyName cf 2023-07-17 12:12:55,509 INFO [StoreOpener-232a3ebc3c50e84ef5e9592cf4a6ceb7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 232a3ebc3c50e84ef5e9592cf4a6ceb7 columnFamilyName cf 2023-07-17 12:12:55,514 INFO [StoreOpener-10e6d7e318c4395ec3e88dbe8bf37d63-1] regionserver.HStore(310): Store=10e6d7e318c4395ec3e88dbe8bf37d63/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 12:12:55,514 INFO [StoreOpener-232a3ebc3c50e84ef5e9592cf4a6ceb7-1] regionserver.HStore(310): Store=232a3ebc3c50e84ef5e9592cf4a6ceb7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 12:12:55,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithSkipTmp/232a3ebc3c50e84ef5e9592cf4a6ceb7 2023-07-17 12:12:55,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithSkipTmp/10e6d7e318c4395ec3e88dbe8bf37d63 2023-07-17 12:12:55,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithSkipTmp/10e6d7e318c4395ec3e88dbe8bf37d63 2023-07-17 12:12:55,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithSkipTmp/232a3ebc3c50e84ef5e9592cf4a6ceb7 2023-07-17 12:12:55,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 10e6d7e318c4395ec3e88dbe8bf37d63 2023-07-17 12:12:55,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithSkipTmp/10e6d7e318c4395ec3e88dbe8bf37d63/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 12:12:55,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 232a3ebc3c50e84ef5e9592cf4a6ceb7 2023-07-17 12:12:55,520 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 10e6d7e318c4395ec3e88dbe8bf37d63; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74798374, jitterRate=0.11458262801170349}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 12:12:55,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 10e6d7e318c4395ec3e88dbe8bf37d63: 2023-07-17 12:12:55,521 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689595975098.10e6d7e318c4395ec3e88dbe8bf37d63., pid=109, masterSystemTime=1689595975501 2023-07-17 12:12:55,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689595975098.10e6d7e318c4395ec3e88dbe8bf37d63. 2023-07-17 12:12:55,523 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689595975098.10e6d7e318c4395ec3e88dbe8bf37d63. 2023-07-17 12:12:55,524 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=10e6d7e318c4395ec3e88dbe8bf37d63, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:55,524 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689595975098.10e6d7e318c4395ec3e88dbe8bf37d63.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689595975524"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689595975524"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689595975524"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689595975524"}]},"ts":"1689595975524"} 2023-07-17 12:12:55,528 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-17 12:12:55,528 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 10e6d7e318c4395ec3e88dbe8bf37d63, server=jenkins-hbase4.apache.org,34107,1689595859757 in 176 msec 2023-07-17 12:12:55,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithSkipTmp/232a3ebc3c50e84ef5e9592cf4a6ceb7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 12:12:55,529 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=10e6d7e318c4395ec3e88dbe8bf37d63, ASSIGN in 345 msec 2023-07-17 12:12:55,530 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 232a3ebc3c50e84ef5e9592cf4a6ceb7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68797616, jitterRate=0.025164365768432617}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 12:12:55,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 232a3ebc3c50e84ef5e9592cf4a6ceb7: 2023-07-17 12:12:55,531 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689595975098.232a3ebc3c50e84ef5e9592cf4a6ceb7., pid=108, masterSystemTime=1689595975501 2023-07-17 12:12:55,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689595975098.232a3ebc3c50e84ef5e9592cf4a6ceb7. 2023-07-17 12:12:55,532 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689595975098.232a3ebc3c50e84ef5e9592cf4a6ceb7. 2023-07-17 12:12:55,533 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=232a3ebc3c50e84ef5e9592cf4a6ceb7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:55,533 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689595975098.232a3ebc3c50e84ef5e9592cf4a6ceb7.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689595975533"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689595975533"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689595975533"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689595975533"}]},"ts":"1689595975533"} 2023-07-17 12:12:55,536 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-17 12:12:55,536 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 232a3ebc3c50e84ef5e9592cf4a6ceb7, server=jenkins-hbase4.apache.org,44163,1689595859880 in 185 msec 2023-07-17 12:12:55,538 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-17 12:12:55,539 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=232a3ebc3c50e84ef5e9592cf4a6ceb7, ASSIGN in 353 msec 2023-07-17 12:12:55,539 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 12:12:55,539 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595975539"}]},"ts":"1689595975539"} 2023-07-17 12:12:55,540 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-17 12:12:55,543 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 12:12:55,543 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-17 12:12:55,545 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44163] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-17 12:12:55,547 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:55,547 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:55,547 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:55,547 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:12:55,548 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,548 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-17 12:12:55,548 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-17 12:12:55,549 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-17 12:12:55,549 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-17 12:12:55,551 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 450 msec 2023-07-17 12:12:55,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-17 12:12:55,709 INFO [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-17 12:12:55,709 DEBUG [Listener at jenkins-hbase4.apache.org/42275] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-17 12:12:55,709 INFO [Listener at jenkins-hbase4.apache.org/42275] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 12:12:55,713 INFO [Listener at jenkins-hbase4.apache.org/42275] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-17 12:12:55,713 INFO [Listener at jenkins-hbase4.apache.org/42275] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 12:12:55,713 INFO [Listener at jenkins-hbase4.apache.org/42275] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-17 12:12:55,716 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-17 12:12:55,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689595975716 (current time:1689595975716). 2023-07-17 12:12:55,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 12:12:55,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(139): Connect 0x3f2bd0da to 127.0.0.1:60075 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:12:55,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@235bb903, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:12:55,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:12:55,735 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48314, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:12:55,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f2bd0da to 127.0.0.1:60075 2023-07-17 12:12:55,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:12:55,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(139): Connect 0x60830844 to 127.0.0.1:60075 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:12:55,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1cfb98e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:12:55,743 DEBUG [hconnection-0x7f228b15-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:12:55,745 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48318, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:12:55,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:12:55,752 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35012, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:12:55,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x60830844 to 127.0.0.1:60075 2023-07-17 12:12:55,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:12:55,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-17 12:12:55,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 12:12:55,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-17 12:12:55,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-17 12:12:55,757 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-17 12:12:55,758 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689596575758 2023-07-17 12:12:55,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-17 12:12:55,758 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,759 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 12:12:55,759 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 12:12:55,761 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-17 12:12:55,761 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-17 12:12:55,762 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-07-17 12:12:55,763 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-17 12:12:55,764 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689596575764 2023-07-17 12:12:55,792 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,793 INFO [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-17 12:12:55,793 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:55,794 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-17 12:12:55,794 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-17 12:12:55,795 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,795 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,797 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:55,797 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:55,797 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:55,797 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:55,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:55,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:55,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:55,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:55,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:55,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:55,797 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:55,797 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:55,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,798 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:55,798 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 12:12:55,798 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,798 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-17 12:12:55,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,798 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,799 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-17 12:12:55,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-17 12:12:55,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,799 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-17 12:12:55,799 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,799 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-17 12:12:55,799 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:55,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-17 12:12:55,801 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,801 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-17 12:12:55,801 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-17 12:12:55,801 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:55,801 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-17 12:12:55,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,801 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44163,1689595859880' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-17 12:12:55,801 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-17 12:12:55,803 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-17 12:12:55,803 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-17 12:12:55,803 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37767,1689595859826' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-17 12:12:55,803 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,803 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-17 12:12:55,803 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:55,807 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-17 12:12:55,807 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-17 12:12:55,807 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34107,1689595859757' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-17 12:12:55,809 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,810 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:55,810 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:55,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:55,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:55,810 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,810 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:12:55,811 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:55,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:55,811 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,811 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,811 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:12:55,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:55,812 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,812 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:12:55,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:55,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:55,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:55,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:55,814 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44163,1689595859880' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-17 12:12:55,814 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4beb5b97[Count = 1] remaining members to acquire global barrier 2023-07-17 12:12:55,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:55,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:55,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:55,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:55,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:55,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:55,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:55,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:55,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:55,816 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34107,1689595859757' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-17 12:12:55,816 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4beb5b97[Count = 0] remaining members to acquire global barrier 2023-07-17 12:12:55,816 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-17 12:12:55,817 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,818 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,819 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,819 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,819 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-17 12:12:55,819 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:55,819 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-17 12:12:55,819 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:12:55,819 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:12:55,819 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-17 12:12:55,819 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689595975098.10e6d7e318c4395ec3e88dbe8bf37d63. 2023-07-17 12:12:55,819 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-17 12:12:55,820 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:12:55,820 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:12:55,820 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689595975098.10e6d7e318c4395ec3e88dbe8bf37d63. started... 2023-07-17 12:12:55,820 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:55,820 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 12:12:55,820 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689595975098.232a3ebc3c50e84ef5e9592cf4a6ceb7. 2023-07-17 12:12:55,820 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37767,1689595859826' in zk 2023-07-17 12:12:55,822 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 10e6d7e318c4395ec3e88dbe8bf37d63: 2023-07-17 12:12:55,822 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689595975098.232a3ebc3c50e84ef5e9592cf4a6ceb7. started... 2023-07-17 12:12:55,822 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689595975098.10e6d7e318c4395ec3e88dbe8bf37d63.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,822 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:12:55,823 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 232a3ebc3c50e84ef5e9592cf4a6ceb7: 2023-07-17 12:12:55,823 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 12:12:55,823 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689595975098.232a3ebc3c50e84ef5e9592cf4a6ceb7.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,824 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:12:55,824 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 12:12:55,824 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-17 12:12:55,824 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:55,825 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-17 12:12:55,853 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689595975098.10e6d7e318c4395ec3e88dbe8bf37d63. completed. 2023-07-17 12:12:55,853 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689595975098.10e6d7e318c4395ec3e88dbe8bf37d63. 2023-07-17 12:12:55,853 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:12:55,853 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:12:55,853 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:55,853 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-17 12:12:55,853 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34107,1689595859757' in zk 2023-07-17 12:12:55,855 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689595975098.232a3ebc3c50e84ef5e9592cf4a6ceb7. completed. 2023-07-17 12:12:55,855 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689595975098.232a3ebc3c50e84ef5e9592cf4a6ceb7. 2023-07-17 12:12:55,855 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:55,855 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:12:55,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:55,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:55,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:55,855 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:12:55,855 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:55,855 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-17 12:12:55,855 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44163,1689595859880' in zk 2023-07-17 12:12:55,856 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-17 12:12:55,856 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:55,856 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-17 12:12:55,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:55,859 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-17 12:12:55,859 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:55,859 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:55,859 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-17 12:12:55,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:55,861 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:12:55,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:55,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-17 12:12:55,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:55,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:12:55,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:55,863 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 12:12:55,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:55,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:55,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:55,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:55,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,34107,1689595859757': 2023-07-17 12:12:55,865 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34107,1689595859757' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-17 12:12:55,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:55,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:55,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:55,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:55,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:55,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:55,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:55,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:55,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:55,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:55,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:55,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:55,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,44163,1689595859880': 2023-07-17 12:12:55,869 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44163,1689595859880' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-17 12:12:55,869 INFO [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-17 12:12:55,869 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 12:12:55,869 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 12:12:55,869 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,869 INFO [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 12:12:55,872 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,872 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,872 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,872 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:55,872 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,872 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:55,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,872 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:55,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:55,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:55,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:55,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:55,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:55,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:55,873 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:55,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:55,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:55,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:55,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,875 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:55,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:55,875 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:55,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:55,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:55,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:55,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:55,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,877 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:55,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:55,878 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:55,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:55,878 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:55,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:55,881 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:55,881 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:55,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:55,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:55,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:55,881 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:55,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:55,881 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:55,881 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:55,881 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:55,881 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:55,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:55,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:55,881 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:55,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:55,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:55,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:55,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:55,883 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,881 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,883 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:55,883 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,883 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:55,883 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:55,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:55,883 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:55,884 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,884 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:55,884 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:55,884 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,884 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,885 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,930 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,951 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-17 12:12:55,951 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,951 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:55,951 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689595975758Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689595975883 (+125 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689595975883Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689595975888 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689595975925 (+37 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689595975951 (+26 ms) 2023-07-17 12:12:55,954 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-17 12:12:55,955 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 195 msec 2023-07-17 12:12:56,063 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:12:56,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-17 12:12:56,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 12:12:56,071 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44163] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689595975098.232a3ebc3c50e84ef5e9592cf4a6ceb7. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 12:12:56,071 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34107] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689595975098.10e6d7e318c4395ec3e88dbe8bf37d63. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 12:12:56,074 DEBUG [Listener at jenkins-hbase4.apache.org/42275] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,074 DEBUG [Listener at jenkins-hbase4.apache.org/42275] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689595975098.232a3ebc3c50e84ef5e9592cf4a6ceb7. 2023-07-17 12:12:56,074 INFO [Listener at jenkins-hbase4.apache.org/42275] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 12:12:56,084 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-17 12:12:56,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689595976084 (current time:1689595976084). 2023-07-17 12:12:56,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 12:12:56,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(139): Connect 0x473e8bed to 127.0.0.1:60075 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:12:56,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2c2fda3c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:12:56,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:12:56,094 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48332, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:12:56,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x473e8bed to 127.0.0.1:60075 2023-07-17 12:12:56,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:12:56,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(139): Connect 0x1ba9820e to 127.0.0.1:60075 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 12:12:56,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@287b0375, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 12:12:56,203 DEBUG [hconnection-0x7ad7d27c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:12:56,206 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48344, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:12:56,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 12:12:56,211 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35024, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 12:12:56,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1ba9820e to 127.0.0.1:60075 2023-07-17 12:12:56,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:12:56,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-17 12:12:56,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 12:12:56,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-17 12:12:56,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-17 12:12:56,220 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-17 12:12:56,220 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689596576220 2023-07-17 12:12:56,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-17 12:12:56,220 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,222 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 12:12:56,223 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 12:12:56,224 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-17 12:12:56,224 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-17 12:12:56,225 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 8 msec 2023-07-17 12:12:56,226 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-17 12:12:56,227 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689596576227 2023-07-17 12:12:56,250 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,250 INFO [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-17 12:12:56,250 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:56,252 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-17 12:12:56,252 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-17 12:12:56,255 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,255 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,256 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:56,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:56,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:56,256 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:56,257 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:56,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,257 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:56,258 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,258 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:56,258 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 12:12:56,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-17 12:12:56,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,259 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-17 12:12:56,260 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:56,260 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:56,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:56,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:56,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:56,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:56,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,260 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,260 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-17 12:12:56,261 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:56,261 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,262 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,262 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-17 12:12:56,262 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-17 12:12:56,263 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-17 12:12:56,263 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34107,1689595859757' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-17 12:12:56,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-17 12:12:56,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,263 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-17 12:12:56,263 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,263 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-17 12:12:56,263 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:56,265 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-17 12:12:56,265 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-17 12:12:56,265 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37767,1689595859826' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-17 12:12:56,265 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:56,265 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-17 12:12:56,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,266 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-17 12:12:56,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:56,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:56,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:56,271 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,271 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:12:56,271 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,271 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-17 12:12:56,271 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 12:12:56,273 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-17 12:12:56,273 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-17 12:12:56,273 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44163,1689595859880' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-17 12:12:56,273 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:56,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:56,273 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,273 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:12:56,274 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:56,274 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,275 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,275 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 12:12:56,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:56,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:56,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:56,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:56,277 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34107,1689595859757' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-17 12:12:56,277 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c8aecf7[Count = 1] remaining members to acquire global barrier 2023-07-17 12:12:56,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:56,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:56,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:56,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:56,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:56,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:56,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:56,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:56,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:56,287 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44163,1689595859880' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-17 12:12:56,287 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c8aecf7[Count = 0] remaining members to acquire global barrier 2023-07-17 12:12:56,287 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-17 12:12:56,287 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,292 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,292 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,292 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-17 12:12:56,292 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,292 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:56,292 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:12:56,292 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:12:56,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,292 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689595975098.232a3ebc3c50e84ef5e9592cf4a6ceb7. 2023-07-17 12:12:56,293 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-17 12:12:56,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,293 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-17 12:12:56,293 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-17 12:12:56,293 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37767,1689595859826' in zk 2023-07-17 12:12:56,293 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689595975098.232a3ebc3c50e84ef5e9592cf4a6ceb7. started... 2023-07-17 12:12:56,293 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:56,293 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 12:12:56,293 INFO [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 232a3ebc3c50e84ef5e9592cf4a6ceb7 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-17 12:12:56,294 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 12:12:56,294 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 12:12:56,294 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689595975098.10e6d7e318c4395ec3e88dbe8bf37d63. 2023-07-17 12:12:56,294 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689595975098.10e6d7e318c4395ec3e88dbe8bf37d63. started... 2023-07-17 12:12:56,294 INFO [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 10e6d7e318c4395ec3e88dbe8bf37d63 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-17 12:12:56,294 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-17 12:12:56,295 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:56,295 DEBUG [member: 'jenkins-hbase4.apache.org,37767,1689595859826' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-17 12:12:56,323 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:12:56,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-17 12:12:56,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-17 12:12:56,324 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 12:12:56,335 INFO [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithSkipTmp/232a3ebc3c50e84ef5e9592cf4a6ceb7/.tmp/cf/ea2ed201377e4b9b851ac5cf9d2de174 2023-07-17 12:12:56,344 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithSkipTmp/232a3ebc3c50e84ef5e9592cf4a6ceb7/.tmp/cf/ea2ed201377e4b9b851ac5cf9d2de174 as hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithSkipTmp/232a3ebc3c50e84ef5e9592cf4a6ceb7/cf/ea2ed201377e4b9b851ac5cf9d2de174 2023-07-17 12:12:56,348 INFO [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithSkipTmp/10e6d7e318c4395ec3e88dbe8bf37d63/.tmp/cf/02fdf38f4e9d4512b4c551eea24725d4 2023-07-17 12:12:56,358 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithSkipTmp/10e6d7e318c4395ec3e88dbe8bf37d63/.tmp/cf/02fdf38f4e9d4512b4c551eea24725d4 as hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithSkipTmp/10e6d7e318c4395ec3e88dbe8bf37d63/cf/02fdf38f4e9d4512b4c551eea24725d4 2023-07-17 12:12:56,358 INFO [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithSkipTmp/232a3ebc3c50e84ef5e9592cf4a6ceb7/cf/ea2ed201377e4b9b851ac5cf9d2de174, entries=5, sequenceid=6, filesize=5.2 K 2023-07-17 12:12:56,359 INFO [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 232a3ebc3c50e84ef5e9592cf4a6ceb7 in 66ms, sequenceid=6, compaction requested=false 2023-07-17 12:12:56,362 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 232a3ebc3c50e84ef5e9592cf4a6ceb7: 2023-07-17 12:12:56,362 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689595975098.232a3ebc3c50e84ef5e9592cf4a6ceb7.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,362 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:12:56,362 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithSkipTmp/232a3ebc3c50e84ef5e9592cf4a6ceb7/cf/ea2ed201377e4b9b851ac5cf9d2de174] hfiles 2023-07-17 12:12:56,362 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithSkipTmp/232a3ebc3c50e84ef5e9592cf4a6ceb7/cf/ea2ed201377e4b9b851ac5cf9d2de174 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,366 INFO [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithSkipTmp/10e6d7e318c4395ec3e88dbe8bf37d63/cf/02fdf38f4e9d4512b4c551eea24725d4, entries=45, sequenceid=6, filesize=7.9 K 2023-07-17 12:12:56,367 INFO [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 10e6d7e318c4395ec3e88dbe8bf37d63 in 73ms, sequenceid=6, compaction requested=false 2023-07-17 12:12:56,367 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 10e6d7e318c4395ec3e88dbe8bf37d63: 2023-07-17 12:12:56,367 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689595975098.10e6d7e318c4395ec3e88dbe8bf37d63.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,368 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 12:12:56,368 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithSkipTmp/10e6d7e318c4395ec3e88dbe8bf37d63/cf/02fdf38f4e9d4512b4c551eea24725d4] hfiles 2023-07-17 12:12:56,368 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithSkipTmp/10e6d7e318c4395ec3e88dbe8bf37d63/cf/02fdf38f4e9d4512b4c551eea24725d4 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,381 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689595975098.232a3ebc3c50e84ef5e9592cf4a6ceb7. completed. 2023-07-17 12:12:56,381 DEBUG [rs(jenkins-hbase4.apache.org,44163,1689595859880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689595975098.232a3ebc3c50e84ef5e9592cf4a6ceb7. 2023-07-17 12:12:56,382 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:12:56,382 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:12:56,382 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:56,382 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-17 12:12:56,382 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44163,1689595859880' in zk 2023-07-17 12:12:56,384 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:56,384 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-17 12:12:56,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:56,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:56,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:56,384 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:56,385 DEBUG [member: 'jenkins-hbase4.apache.org,44163,1689595859880' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-17 12:12:56,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:56,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:56,388 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689595975098.10e6d7e318c4395ec3e88dbe8bf37d63. completed. 2023-07-17 12:12:56,388 DEBUG [rs(jenkins-hbase4.apache.org,34107,1689595859757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689595975098.10e6d7e318c4395ec3e88dbe8bf37d63. 2023-07-17 12:12:56,388 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 12:12:56,388 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 12:12:56,388 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:56,388 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-17 12:12:56,388 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34107,1689595859757' in zk 2023-07-17 12:12:56,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:56,390 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:56,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:56,390 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-17 12:12:56,390 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:56,390 DEBUG [member: 'jenkins-hbase4.apache.org,34107,1689595859757' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-17 12:12:56,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:56,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:56,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:56,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:56,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:56,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,44163,1689595859880': 2023-07-17 12:12:56,394 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44163,1689595859880' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-17 12:12:56,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:56,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:56,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:56,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:56,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:56,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:56,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:56,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:56,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:56,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:56,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:56,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:56,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,34107,1689595859757': 2023-07-17 12:12:56,399 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34107,1689595859757' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-17 12:12:56,399 INFO [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-17 12:12:56,399 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 12:12:56,399 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 12:12:56,399 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,399 INFO [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 12:12:56,402 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,402 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,403 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,403 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:56,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,403 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:56,403 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 12:12:56,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 12:12:56,403 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:56,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:56,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:56,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:56,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:56,404 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:56,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 12:12:56,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:56,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:56,404 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:56,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,404 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:56,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 12:12:56,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:56,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:56,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:56,406 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:56,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 12:12:56,407 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:56,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,407 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:56,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:56,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:56,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:56,410 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:56,410 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:56,410 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:56,410 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,410 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,410 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:56,410 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,410 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:56,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:56,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:56,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:56,410 DEBUG [(jenkins-hbase4.apache.org,35573,1689595858202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 12:12:56,410 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:56,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:56,410 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:56,412 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 12:12:56,412 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 12:12:56,412 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:12:56,412 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,412 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:12:56,412 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:12:56,412 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,413 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,412 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 12:12:56,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:56,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 12:12:56,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:56,413 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:56,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:56,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 12:12:56,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 12:12:56,444 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,464 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-17 12:12:56,464 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,465 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,465 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689595976221Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689595976410 (+189 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689595976410Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689595976417 (+7 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689595976435 (+18 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689595976464 (+29 ms) 2023-07-17 12:12:56,468 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-17 12:12:56,469 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 246 msec 2023-07-17 12:12:56,524 DEBUG [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 12:12:56,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-17 12:12:56,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 12:12:56,526 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595976526 2023-07-17 12:12:56,526 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40781, tgtDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595976526, rawTgtDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595976526, srcFsUri=hdfs://localhost:40781, srcDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c 2023-07-17 12:12:56,549 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40781, inputRoot=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c 2023-07-17 12:12:56,549 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2047934128_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595976526, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595976526/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,549 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40781, inputRoot=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c, snapshotDir=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-17 12:12:56,562 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595976526/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:12:56,589 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:56,589 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:56,590 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:56,590 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:56,590 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:56,590 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:56,591 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:56,677 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/hadoop-1758693078163537416.jar 2023-07-17 12:12:56,678 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:56,678 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:56,679 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:56,679 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:56,680 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:56,680 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-17 12:12:56,681 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-17 12:12:56,681 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-17 12:12:56,682 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-17 12:12:56,682 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-17 12:12:56,683 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-17 12:12:56,683 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-17 12:12:56,684 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-17 12:12:56,684 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-17 12:12:56,685 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-17 12:12:56,686 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-17 12:12:56,686 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:12:56,687 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:12:56,687 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 12:12:56,688 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:12:56,688 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 12:12:56,689 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 12:12:56,689 DEBUG [Listener at jenkins-hbase4.apache.org/42275] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 12:12:57,259 WARN [Listener at jenkins-hbase4.apache.org/42275] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-17 12:12:57,261 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-17 12:12:57,264 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-17 12:12:59,140 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 12:12:59,140 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 12:12:59,149 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867780_0006_000001 (auth:SIMPLE) 2023-07-17 12:12:59,381 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867780_0007_000001 (auth:SIMPLE) 2023-07-17 12:13:00,390 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 12:13:05,958 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867780_0007_000001 (auth:SIMPLE) 2023-07-17 12:13:08,329 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867780_0007_000001 (auth:SIMPLE) 2023-07-17 12:13:14,520 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-17 12:13:14,520 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-17 12:13:14,553 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:14,553 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-17 12:13:14,554 INFO [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-17 12:13:14,554 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-269744684_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:14,554 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(367): hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-17 12:13:14,554 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(367): hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-17 12:13:14,554 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-269744684_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595976526/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595976526/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:14,555 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(367): hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595976526/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-17 12:13:14,555 DEBUG [Listener at jenkins-hbase4.apache.org/42275] snapshot.TestExportSnapshot(367): hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/export-test/export-1689595976526/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-17 12:13:14,576 INFO [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:14,577 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:14,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:14,582 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595994582"}]},"ts":"1689595994582"} 2023-07-17 12:13:14,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-17 12:13:14,583 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-17 12:13:14,585 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-17 12:13:14,587 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=232a3ebc3c50e84ef5e9592cf4a6ceb7, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=10e6d7e318c4395ec3e88dbe8bf37d63, UNASSIGN}] 2023-07-17 12:13:14,588 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=232a3ebc3c50e84ef5e9592cf4a6ceb7, UNASSIGN 2023-07-17 12:13:14,590 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=10e6d7e318c4395ec3e88dbe8bf37d63, UNASSIGN 2023-07-17 12:13:14,590 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=10e6d7e318c4395ec3e88dbe8bf37d63, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:13:14,590 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=232a3ebc3c50e84ef5e9592cf4a6ceb7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:13:14,591 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689595975098.10e6d7e318c4395ec3e88dbe8bf37d63.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689595994590"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595994590"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595994590"}]},"ts":"1689595994590"} 2023-07-17 12:13:14,591 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689595975098.232a3ebc3c50e84ef5e9592cf4a6ceb7.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689595994590"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689595994590"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689595994590"}]},"ts":"1689595994590"} 2023-07-17 12:13:14,593 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure 10e6d7e318c4395ec3e88dbe8bf37d63, server=jenkins-hbase4.apache.org,34107,1689595859757}] 2023-07-17 12:13:14,604 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure 232a3ebc3c50e84ef5e9592cf4a6ceb7, server=jenkins-hbase4.apache.org,44163,1689595859880}] 2023-07-17 12:13:14,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-17 12:13:14,755 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 10e6d7e318c4395ec3e88dbe8bf37d63 2023-07-17 12:13:14,755 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 10e6d7e318c4395ec3e88dbe8bf37d63, disabling compactions & flushes 2023-07-17 12:13:14,755 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689595975098.10e6d7e318c4395ec3e88dbe8bf37d63. 2023-07-17 12:13:14,755 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689595975098.10e6d7e318c4395ec3e88dbe8bf37d63. 2023-07-17 12:13:14,755 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689595975098.10e6d7e318c4395ec3e88dbe8bf37d63. after waiting 0 ms 2023-07-17 12:13:14,755 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689595975098.10e6d7e318c4395ec3e88dbe8bf37d63. 2023-07-17 12:13:14,762 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 232a3ebc3c50e84ef5e9592cf4a6ceb7 2023-07-17 12:13:14,762 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 232a3ebc3c50e84ef5e9592cf4a6ceb7, disabling compactions & flushes 2023-07-17 12:13:14,762 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689595975098.232a3ebc3c50e84ef5e9592cf4a6ceb7. 2023-07-17 12:13:14,762 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689595975098.232a3ebc3c50e84ef5e9592cf4a6ceb7. 2023-07-17 12:13:14,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689595975098.232a3ebc3c50e84ef5e9592cf4a6ceb7. after waiting 1 ms 2023-07-17 12:13:14,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689595975098.232a3ebc3c50e84ef5e9592cf4a6ceb7. 2023-07-17 12:13:14,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithSkipTmp/10e6d7e318c4395ec3e88dbe8bf37d63/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 12:13:14,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:13:14,790 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689595975098.10e6d7e318c4395ec3e88dbe8bf37d63. 2023-07-17 12:13:14,790 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 10e6d7e318c4395ec3e88dbe8bf37d63: 2023-07-17 12:13:14,794 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 10e6d7e318c4395ec3e88dbe8bf37d63 2023-07-17 12:13:14,794 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=10e6d7e318c4395ec3e88dbe8bf37d63, regionState=CLOSED 2023-07-17 12:13:14,795 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689595975098.10e6d7e318c4395ec3e88dbe8bf37d63.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689595994794"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595994794"}]},"ts":"1689595994794"} 2023-07-17 12:13:14,801 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-07-17 12:13:14,801 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure 10e6d7e318c4395ec3e88dbe8bf37d63, server=jenkins-hbase4.apache.org,34107,1689595859757 in 204 msec 2023-07-17 12:13:14,803 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=10e6d7e318c4395ec3e88dbe8bf37d63, UNASSIGN in 214 msec 2023-07-17 12:13:14,807 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/default/testtb-testExportFileSystemStateWithSkipTmp/232a3ebc3c50e84ef5e9592cf4a6ceb7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 12:13:14,809 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:13:14,811 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689595975098.232a3ebc3c50e84ef5e9592cf4a6ceb7. 2023-07-17 12:13:14,811 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 232a3ebc3c50e84ef5e9592cf4a6ceb7: 2023-07-17 12:13:14,813 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 232a3ebc3c50e84ef5e9592cf4a6ceb7 2023-07-17 12:13:14,814 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=232a3ebc3c50e84ef5e9592cf4a6ceb7, regionState=CLOSED 2023-07-17 12:13:14,814 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689595975098.232a3ebc3c50e84ef5e9592cf4a6ceb7.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689595994814"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689595994814"}]},"ts":"1689595994814"} 2023-07-17 12:13:14,817 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=115 2023-07-17 12:13:14,817 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure 232a3ebc3c50e84ef5e9592cf4a6ceb7, server=jenkins-hbase4.apache.org,44163,1689595859880 in 212 msec 2023-07-17 12:13:14,819 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=114 2023-07-17 12:13:14,819 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=232a3ebc3c50e84ef5e9592cf4a6ceb7, UNASSIGN in 230 msec 2023-07-17 12:13:14,820 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689595994820"}]},"ts":"1689595994820"} 2023-07-17 12:13:14,827 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-17 12:13:14,830 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-17 12:13:14,833 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 254 msec 2023-07-17 12:13:14,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-17 12:13:14,887 INFO [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-17 12:13:14,888 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:14,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:14,892 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:14,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:14,893 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:14,896 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44163] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:14,899 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:14,899 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:14,900 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:14,900 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-17 12:13:14,901 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-17 12:13:14,901 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-17 12:13:14,901 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:14,901 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-17 12:13:14,902 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:14,902 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:14,902 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:14,902 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:13:14,903 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:13:14,902 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:13:14,902 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:14,903 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 12:13:14,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-17 12:13:14,907 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/232a3ebc3c50e84ef5e9592cf4a6ceb7 2023-07-17 12:13:14,907 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/10e6d7e318c4395ec3e88dbe8bf37d63 2023-07-17 12:13:14,909 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/232a3ebc3c50e84ef5e9592cf4a6ceb7/cf, FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/232a3ebc3c50e84ef5e9592cf4a6ceb7/recovered.edits] 2023-07-17 12:13:14,910 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/10e6d7e318c4395ec3e88dbe8bf37d63/cf, FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/10e6d7e318c4395ec3e88dbe8bf37d63/recovered.edits] 2023-07-17 12:13:14,917 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/232a3ebc3c50e84ef5e9592cf4a6ceb7/cf/ea2ed201377e4b9b851ac5cf9d2de174 to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/232a3ebc3c50e84ef5e9592cf4a6ceb7/cf/ea2ed201377e4b9b851ac5cf9d2de174 2023-07-17 12:13:14,918 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/10e6d7e318c4395ec3e88dbe8bf37d63/cf/02fdf38f4e9d4512b4c551eea24725d4 to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/10e6d7e318c4395ec3e88dbe8bf37d63/cf/02fdf38f4e9d4512b4c551eea24725d4 2023-07-17 12:13:14,921 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/232a3ebc3c50e84ef5e9592cf4a6ceb7/recovered.edits/9.seqid to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/232a3ebc3c50e84ef5e9592cf4a6ceb7/recovered.edits/9.seqid 2023-07-17 12:13:14,921 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/232a3ebc3c50e84ef5e9592cf4a6ceb7 2023-07-17 12:13:14,921 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/10e6d7e318c4395ec3e88dbe8bf37d63/recovered.edits/9.seqid to hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/10e6d7e318c4395ec3e88dbe8bf37d63/recovered.edits/9.seqid 2023-07-17 12:13:14,922 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/10e6d7e318c4395ec3e88dbe8bf37d63 2023-07-17 12:13:14,922 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-17 12:13:14,924 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:14,927 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-17 12:13:14,929 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-17 12:13:14,930 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:14,930 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-17 12:13:14,930 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689595975098.232a3ebc3c50e84ef5e9592cf4a6ceb7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689595994930"}]},"ts":"9223372036854775807"} 2023-07-17 12:13:14,930 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689595975098.10e6d7e318c4395ec3e88dbe8bf37d63.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689595994930"}]},"ts":"9223372036854775807"} 2023-07-17 12:13:14,932 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-17 12:13:14,932 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 232a3ebc3c50e84ef5e9592cf4a6ceb7, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689595975098.232a3ebc3c50e84ef5e9592cf4a6ceb7.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 10e6d7e318c4395ec3e88dbe8bf37d63, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689595975098.10e6d7e318c4395ec3e88dbe8bf37d63.', STARTKEY => '1', ENDKEY => ''}] 2023-07-17 12:13:14,933 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-17 12:13:14,933 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689595994933"}]},"ts":"9223372036854775807"} 2023-07-17 12:13:14,934 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-17 12:13:14,938 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:14,939 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 50 msec 2023-07-17 12:13:15,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-17 12:13:15,005 INFO [Listener at jenkins-hbase4.apache.org/42275] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-17 12:13:15,015 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-17 12:13:15,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:15,019 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-17 12:13:15,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35573] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 12:13:15,061 INFO [Listener at jenkins-hbase4.apache.org/42275] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766 (was 762) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_974021899_17 at /127.0.0.1:54388 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-899848362_1 at /127.0.0.1:54354 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-899848362_1 at /127.0.0.1:57564 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x24b8e848-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (905985230) connection to jenkins-hbase4.apache.org/172.31.14.131:37737 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-269744684_17 at /127.0.0.1:44270 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5313 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x24b8e848-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-269744684_17 at /127.0.0.1:57580 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x24b8e848-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x24b8e848-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=913 (was 914), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=718 (was 688) - SystemLoadAverage LEAK? -, ProcessCount=186 (was 183) - ProcessCount LEAK? -, AvailableMemoryMB=411 (was 1639) 2023-07-17 12:13:15,061 WARN [Listener at jenkins-hbase4.apache.org/42275] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-07-17 12:13:15,061 INFO [Listener at jenkins-hbase4.apache.org/42275] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-17 12:13:15,073 INFO [Listener at jenkins-hbase4.apache.org/42275] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-17 12:13:19,455 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689595867780_0007_000001 (auth:SIMPLE) 2023-07-17 12:13:20,365 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 12:13:29,209 INFO [Listener at jenkins-hbase4.apache.org/42275] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-17 12:13:43,330 ERROR [Thread[Thread-408,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-17 12:13:43,331 INFO [Listener at jenkins-hbase4.apache.org/42275] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-17 12:13:43,450 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-17 12:13:43,475 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-17 12:13:43,476 ERROR [Thread[Thread-418,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-17 12:13:43,505 INFO [Listener at jenkins-hbase4.apache.org/42275] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-17 12:13:43,610 ERROR [Thread[Thread-383,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-17 12:13:43,611 INFO [Listener at jenkins-hbase4.apache.org/42275] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-17 12:13:43,611 INFO [Listener at jenkins-hbase4.apache.org/42275] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-17 12:13:43,611 INFO [Listener at jenkins-hbase4.apache.org/42275] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-17 12:13:43,611 DEBUG [Listener at jenkins-hbase4.apache.org/42275] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3589465b to 127.0.0.1:60075 2023-07-17 12:13:43,611 DEBUG [Listener at jenkins-hbase4.apache.org/42275] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:13:43,611 DEBUG [Listener at jenkins-hbase4.apache.org/42275] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-17 12:13:43,611 DEBUG [Listener at jenkins-hbase4.apache.org/42275] util.JVMClusterUtil(257): Found active master hash=1556229407, stopped=false 2023-07-17 12:13:43,611 DEBUG [Listener at jenkins-hbase4.apache.org/42275] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:13:43,612 DEBUG [Listener at jenkins-hbase4.apache.org/42275] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-17 12:13:43,612 INFO [Listener at jenkins-hbase4.apache.org/42275] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,35573,1689595858202 2023-07-17 12:13:43,614 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-17 12:13:43,614 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-17 12:13:43,614 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 12:13:43,614 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-17 12:13:43,614 INFO [Listener at jenkins-hbase4.apache.org/42275] procedure2.ProcedureExecutor(629): Stopping 2023-07-17 12:13:43,614 DEBUG [Listener at jenkins-hbase4.apache.org/42275] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3489156c to 127.0.0.1:60075 2023-07-17 12:13:43,614 DEBUG [Listener at jenkins-hbase4.apache.org/42275] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:13:43,614 INFO [Listener at jenkins-hbase4.apache.org/42275] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,34107,1689595859757' ***** 2023-07-17 12:13:43,615 DEBUG [Listener at jenkins-hbase4.apache.org/42275] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:13:43,615 INFO [Listener at jenkins-hbase4.apache.org/42275] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-17 12:13:43,615 INFO [Listener at jenkins-hbase4.apache.org/42275] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,37767,1689595859826' ***** 2023-07-17 12:13:43,615 DEBUG [Listener at jenkins-hbase4.apache.org/42275] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:13:43,615 INFO [Listener at jenkins-hbase4.apache.org/42275] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-17 12:13:43,615 INFO [Listener at jenkins-hbase4.apache.org/42275] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,44163,1689595859880' ***** 2023-07-17 12:13:43,615 DEBUG [Listener at jenkins-hbase4.apache.org/42275] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:13:43,615 INFO [RS:1;jenkins-hbase4:37767] regionserver.HeapMemoryManager(220): Stopping 2023-07-17 12:13:43,615 INFO [RS:1;jenkins-hbase4:37767] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-17 12:13:43,615 INFO [RS:1;jenkins-hbase4:37767] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-17 12:13:43,616 INFO [RS:1;jenkins-hbase4:37767] regionserver.HRegionServer(3305): Received CLOSE for 9053df43c9bd02edab5ac7066000f09f 2023-07-17 12:13:43,616 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 12:13:43,616 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 12:13:43,615 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-17 12:13:43,619 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 12:13:43,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9053df43c9bd02edab5ac7066000f09f, disabling compactions & flushes 2023-07-17 12:13:43,619 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689595862709.9053df43c9bd02edab5ac7066000f09f. 2023-07-17 12:13:43,619 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689595862709.9053df43c9bd02edab5ac7066000f09f. 2023-07-17 12:13:43,619 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689595862709.9053df43c9bd02edab5ac7066000f09f. after waiting 0 ms 2023-07-17 12:13:43,619 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689595862709.9053df43c9bd02edab5ac7066000f09f. 2023-07-17 12:13:43,619 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 9053df43c9bd02edab5ac7066000f09f 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-17 12:13:43,616 INFO [RS:1;jenkins-hbase4:37767] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:13:43,619 DEBUG [RS:1;jenkins-hbase4:37767] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x536d3d9a to 127.0.0.1:60075 2023-07-17 12:13:43,619 DEBUG [RS:1;jenkins-hbase4:37767] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:13:43,615 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-17 12:13:43,620 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 12:13:43,615 INFO [Listener at jenkins-hbase4.apache.org/42275] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-17 12:13:43,615 INFO [RS:0;jenkins-hbase4:34107] regionserver.HeapMemoryManager(220): Stopping 2023-07-17 12:13:43,622 INFO [RS:1;jenkins-hbase4:37767] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-17 12:13:43,622 INFO [RS:2;jenkins-hbase4:44163] regionserver.HeapMemoryManager(220): Stopping 2023-07-17 12:13:43,622 DEBUG [RS:1;jenkins-hbase4:37767] regionserver.HRegionServer(1478): Online Regions={9053df43c9bd02edab5ac7066000f09f=hbase:namespace,,1689595862709.9053df43c9bd02edab5ac7066000f09f.} 2023-07-17 12:13:43,622 INFO [RS:2;jenkins-hbase4:44163] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-17 12:13:43,623 INFO [RS:2;jenkins-hbase4:44163] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-17 12:13:43,623 INFO [RS:2;jenkins-hbase4:44163] regionserver.HRegionServer(3305): Received CLOSE for 5bddfb1236aca85b6b8a6c8b72c5e466 2023-07-17 12:13:43,623 INFO [RS:2;jenkins-hbase4:44163] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:13:43,623 DEBUG [RS:2;jenkins-hbase4:44163] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x17a516e2 to 127.0.0.1:60075 2023-07-17 12:13:43,623 DEBUG [RS:2;jenkins-hbase4:44163] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:13:43,623 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-17 12:13:43,622 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-17 12:13:43,622 INFO [RS:0;jenkins-hbase4:34107] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-17 12:13:43,624 INFO [RS:0;jenkins-hbase4:34107] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-17 12:13:43,624 DEBUG [RS:1;jenkins-hbase4:37767] regionserver.HRegionServer(1504): Waiting on 9053df43c9bd02edab5ac7066000f09f 2023-07-17 12:13:43,626 INFO [RS:0;jenkins-hbase4:34107] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:13:43,627 DEBUG [RS:0;jenkins-hbase4:34107] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c72b8e9 to 127.0.0.1:60075 2023-07-17 12:13:43,627 DEBUG [RS:0;jenkins-hbase4:34107] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:13:43,627 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5bddfb1236aca85b6b8a6c8b72c5e466, disabling compactions & flushes 2023-07-17 12:13:43,627 INFO [RS:2;jenkins-hbase4:44163] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-17 12:13:43,628 DEBUG [RS:2;jenkins-hbase4:44163] regionserver.HRegionServer(1478): Online Regions={5bddfb1236aca85b6b8a6c8b72c5e466=hbase:acl,,1689595863473.5bddfb1236aca85b6b8a6c8b72c5e466.} 2023-07-17 12:13:43,628 DEBUG [RS:2;jenkins-hbase4:44163] regionserver.HRegionServer(1504): Waiting on 5bddfb1236aca85b6b8a6c8b72c5e466 2023-07-17 12:13:43,627 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689595863473.5bddfb1236aca85b6b8a6c8b72c5e466. 2023-07-17 12:13:43,628 INFO [RS:0;jenkins-hbase4:34107] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-17 12:13:43,628 INFO [RS:0;jenkins-hbase4:34107] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-17 12:13:43,628 INFO [RS:0;jenkins-hbase4:34107] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-17 12:13:43,628 INFO [RS:0;jenkins-hbase4:34107] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-17 12:13:43,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689595863473.5bddfb1236aca85b6b8a6c8b72c5e466. 2023-07-17 12:13:43,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689595863473.5bddfb1236aca85b6b8a6c8b72c5e466. after waiting 0 ms 2023-07-17 12:13:43,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689595863473.5bddfb1236aca85b6b8a6c8b72c5e466. 2023-07-17 12:13:43,628 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 5bddfb1236aca85b6b8a6c8b72c5e466 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-17 12:13:43,635 INFO [RS:0;jenkins-hbase4:34107] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-17 12:13:43,635 DEBUG [RS:0;jenkins-hbase4:34107] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-17 12:13:43,635 DEBUG [RS:0;jenkins-hbase4:34107] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-17 12:13:43,647 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-17 12:13:43,648 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-17 12:13:43,648 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-17 12:13:43,648 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-17 12:13:43,648 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-17 12:13:43,648 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-17 12:13:43,683 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-17 12:13:43,693 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-17 12:13:43,703 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-17 12:13:43,711 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/hbase/namespace/9053df43c9bd02edab5ac7066000f09f/.tmp/info/349507657d9349f881611c3bb48046a0 2023-07-17 12:13:43,715 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/hbase/acl/5bddfb1236aca85b6b8a6c8b72c5e466/.tmp/l/d4ffef3ad51f40d2abbabfb6a92d72b8 2023-07-17 12:13:43,726 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d4ffef3ad51f40d2abbabfb6a92d72b8 2023-07-17 12:13:43,727 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/hbase/meta/1588230740/.tmp/info/ccc38053a0ce4a18a4502870aa2ece89 2023-07-17 12:13:43,727 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/hbase/acl/5bddfb1236aca85b6b8a6c8b72c5e466/.tmp/l/d4ffef3ad51f40d2abbabfb6a92d72b8 as hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/hbase/acl/5bddfb1236aca85b6b8a6c8b72c5e466/l/d4ffef3ad51f40d2abbabfb6a92d72b8 2023-07-17 12:13:43,728 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/hbase/namespace/9053df43c9bd02edab5ac7066000f09f/.tmp/info/349507657d9349f881611c3bb48046a0 as hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/hbase/namespace/9053df43c9bd02edab5ac7066000f09f/info/349507657d9349f881611c3bb48046a0 2023-07-17 12:13:43,733 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ccc38053a0ce4a18a4502870aa2ece89 2023-07-17 12:13:43,744 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/hbase/namespace/9053df43c9bd02edab5ac7066000f09f/info/349507657d9349f881611c3bb48046a0, entries=2, sequenceid=6, filesize=4.8 K 2023-07-17 12:13:43,744 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d4ffef3ad51f40d2abbabfb6a92d72b8 2023-07-17 12:13:43,745 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/hbase/acl/5bddfb1236aca85b6b8a6c8b72c5e466/l/d4ffef3ad51f40d2abbabfb6a92d72b8, entries=7, sequenceid=18, filesize=5.2 K 2023-07-17 12:13:43,745 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 9053df43c9bd02edab5ac7066000f09f in 126ms, sequenceid=6, compaction requested=false 2023-07-17 12:13:43,745 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 5bddfb1236aca85b6b8a6c8b72c5e466 in 117ms, sequenceid=18, compaction requested=false 2023-07-17 12:13:43,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/hbase/namespace/9053df43c9bd02edab5ac7066000f09f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 12:13:43,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:13:43,765 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689595862709.9053df43c9bd02edab5ac7066000f09f. 2023-07-17 12:13:43,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9053df43c9bd02edab5ac7066000f09f: 2023-07-17 12:13:43,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689595862709.9053df43c9bd02edab5ac7066000f09f. 2023-07-17 12:13:43,775 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/hbase/meta/1588230740/.tmp/rep_barrier/e1d370a5f3494161bb2359ab055bc0f9 2023-07-17 12:13:43,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/hbase/acl/5bddfb1236aca85b6b8a6c8b72c5e466/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-17 12:13:43,791 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:13:43,792 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689595863473.5bddfb1236aca85b6b8a6c8b72c5e466. 2023-07-17 12:13:43,792 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5bddfb1236aca85b6b8a6c8b72c5e466: 2023-07-17 12:13:43,792 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689595863473.5bddfb1236aca85b6b8a6c8b72c5e466. 2023-07-17 12:13:43,804 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e1d370a5f3494161bb2359ab055bc0f9 2023-07-17 12:13:43,824 INFO [RS:1;jenkins-hbase4:37767] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,37767,1689595859826; all regions closed. 2023-07-17 12:13:43,831 INFO [RS:2;jenkins-hbase4:44163] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,44163,1689595859880; all regions closed. 2023-07-17 12:13:43,835 DEBUG [RS:0;jenkins-hbase4:34107] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-17 12:13:43,890 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/hbase/meta/1588230740/.tmp/table/98dfbef4f9d0466089a407ec696d47d1 2023-07-17 12:13:43,901 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 98dfbef4f9d0466089a407ec696d47d1 2023-07-17 12:13:43,904 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/hbase/meta/1588230740/.tmp/info/ccc38053a0ce4a18a4502870aa2ece89 as hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/hbase/meta/1588230740/info/ccc38053a0ce4a18a4502870aa2ece89 2023-07-17 12:13:43,909 DEBUG [RS:2;jenkins-hbase4:44163] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/oldWALs 2023-07-17 12:13:43,909 DEBUG [RS:1;jenkins-hbase4:37767] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/oldWALs 2023-07-17 12:13:43,909 INFO [RS:1;jenkins-hbase4:37767] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37767%2C1689595859826:(num 1689595862134) 2023-07-17 12:13:43,909 DEBUG [RS:1;jenkins-hbase4:37767] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:13:43,910 INFO [RS:1;jenkins-hbase4:37767] regionserver.LeaseManager(133): Closed leases 2023-07-17 12:13:43,909 INFO [RS:2;jenkins-hbase4:44163] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44163%2C1689595859880:(num 1689595862135) 2023-07-17 12:13:43,910 DEBUG [RS:2;jenkins-hbase4:44163] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:13:43,910 INFO [RS:2;jenkins-hbase4:44163] regionserver.LeaseManager(133): Closed leases 2023-07-17 12:13:43,911 INFO [RS:2;jenkins-hbase4:44163] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-17 12:13:43,911 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-17 12:13:43,911 INFO [RS:2;jenkins-hbase4:44163] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-17 12:13:43,911 INFO [RS:2;jenkins-hbase4:44163] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-17 12:13:43,911 INFO [RS:2;jenkins-hbase4:44163] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-17 12:13:43,911 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-17 12:13:43,911 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-17 12:13:43,912 INFO [RS:1;jenkins-hbase4:37767] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-17 12:13:43,914 INFO [RS:1;jenkins-hbase4:37767] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-17 12:13:43,914 INFO [RS:1;jenkins-hbase4:37767] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-17 12:13:43,914 INFO [RS:1;jenkins-hbase4:37767] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-17 12:13:43,914 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-17 12:13:43,914 INFO [RS:2;jenkins-hbase4:44163] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44163 2023-07-17 12:13:43,919 INFO [RS:1;jenkins-hbase4:37767] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37767 2023-07-17 12:13:43,920 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ccc38053a0ce4a18a4502870aa2ece89 2023-07-17 12:13:43,920 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/hbase/meta/1588230740/info/ccc38053a0ce4a18a4502870aa2ece89, entries=48, sequenceid=131, filesize=10.3 K 2023-07-17 12:13:43,921 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/hbase/meta/1588230740/.tmp/rep_barrier/e1d370a5f3494161bb2359ab055bc0f9 as hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/hbase/meta/1588230740/rep_barrier/e1d370a5f3494161bb2359ab055bc0f9 2023-07-17 12:13:43,926 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:13:43,926 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:13:43,926 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-17 12:13:43,926 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-17 12:13:43,927 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-17 12:13:43,927 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37767,1689595859826 2023-07-17 12:13:43,927 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-17 12:13:43,927 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e1d370a5f3494161bb2359ab055bc0f9 2023-07-17 12:13:43,927 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37767,1689595859826] 2023-07-17 12:13:43,928 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37767,1689595859826; numProcessing=1 2023-07-17 12:13:43,930 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/hbase/meta/1588230740/rep_barrier/e1d370a5f3494161bb2359ab055bc0f9, entries=13, sequenceid=131, filesize=6.4 K 2023-07-17 12:13:43,932 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/hbase/meta/1588230740/.tmp/table/98dfbef4f9d0466089a407ec696d47d1 as hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/hbase/meta/1588230740/table/98dfbef4f9d0466089a407ec696d47d1 2023-07-17 12:13:43,933 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-17 12:13:43,933 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:13:43,933 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37767,1689595859826 already deleted, retry=false 2023-07-17 12:13:43,933 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37767,1689595859826 expired; onlineServers=2 2023-07-17 12:13:43,933 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44163,1689595859880 2023-07-17 12:13:43,933 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44163,1689595859880] 2023-07-17 12:13:43,933 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44163,1689595859880; numProcessing=2 2023-07-17 12:13:43,935 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44163,1689595859880 already deleted, retry=false 2023-07-17 12:13:43,935 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44163,1689595859880 expired; onlineServers=1 2023-07-17 12:13:43,945 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 98dfbef4f9d0466089a407ec696d47d1 2023-07-17 12:13:43,945 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/hbase/meta/1588230740/table/98dfbef4f9d0466089a407ec696d47d1, entries=24, sequenceid=131, filesize=6.9 K 2023-07-17 12:13:43,947 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 299ms, sequenceid=131, compaction requested=false 2023-07-17 12:13:43,973 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-17 12:13:43,974 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 12:13:43,974 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-17 12:13:43,976 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-17 12:13:43,976 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-17 12:13:43,976 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-17 12:13:44,029 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 12:13:44,029 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:37767-0x10173314c320002, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 12:13:44,029 INFO [RS:1;jenkins-hbase4:37767] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,37767,1689595859826; zookeeper connection closed. 2023-07-17 12:13:44,031 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@466c02f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@466c02f 2023-07-17 12:13:44,035 INFO [RS:0;jenkins-hbase4:34107] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,34107,1689595859757; all regions closed. 2023-07-17 12:13:44,042 DEBUG [RS:0;jenkins-hbase4:34107] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/oldWALs 2023-07-17 12:13:44,042 INFO [RS:0;jenkins-hbase4:34107] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34107%2C1689595859757.meta:.meta(num 1689595862281) 2023-07-17 12:13:44,056 DEBUG [RS:0;jenkins-hbase4:34107] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/oldWALs 2023-07-17 12:13:44,056 INFO [RS:0;jenkins-hbase4:34107] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34107%2C1689595859757:(num 1689595862135) 2023-07-17 12:13:44,056 DEBUG [RS:0;jenkins-hbase4:34107] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:13:44,056 INFO [RS:0;jenkins-hbase4:34107] regionserver.LeaseManager(133): Closed leases 2023-07-17 12:13:44,056 INFO [RS:0;jenkins-hbase4:34107] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-17 12:13:44,056 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-17 12:13:44,057 INFO [RS:0;jenkins-hbase4:34107] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34107 2023-07-17 12:13:44,059 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-17 12:13:44,059 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34107,1689595859757 2023-07-17 12:13:44,061 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34107,1689595859757] 2023-07-17 12:13:44,061 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34107,1689595859757; numProcessing=3 2023-07-17 12:13:44,062 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34107,1689595859757 already deleted, retry=false 2023-07-17 12:13:44,062 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34107,1689595859757 expired; onlineServers=0 2023-07-17 12:13:44,063 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,35573,1689595858202' ***** 2023-07-17 12:13:44,063 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-17 12:13:44,063 DEBUG [M:0;jenkins-hbase4:35573] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1dff2724, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-17 12:13:44,063 INFO [M:0;jenkins-hbase4:35573] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,35573,1689595858202 2023-07-17 12:13:44,063 INFO [M:0;jenkins-hbase4:35573] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,35573,1689595858202; all regions closed. 2023-07-17 12:13:44,063 DEBUG [M:0;jenkins-hbase4:35573] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 12:13:44,063 DEBUG [M:0;jenkins-hbase4:35573] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-17 12:13:44,063 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-17 12:13:44,063 DEBUG [M:0;jenkins-hbase4:35573] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-17 12:13:44,063 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689595861590] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689595861590,5,FailOnTimeoutGroup] 2023-07-17 12:13:44,063 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689595861591] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689595861591,5,FailOnTimeoutGroup] 2023-07-17 12:13:44,063 INFO [M:0;jenkins-hbase4:35573] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-17 12:13:44,064 INFO [M:0;jenkins-hbase4:35573] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-17 12:13:44,064 INFO [M:0;jenkins-hbase4:35573] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-17 12:13:44,064 DEBUG [M:0;jenkins-hbase4:35573] master.HMaster(1512): Stopping service threads 2023-07-17 12:13:44,064 INFO [M:0;jenkins-hbase4:35573] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-17 12:13:44,064 ERROR [M:0;jenkins-hbase4:35573] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-17 12:13:44,065 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-17 12:13:44,065 INFO [M:0;jenkins-hbase4:35573] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-17 12:13:44,065 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 12:13:44,065 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-17 12:13:44,066 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-17 12:13:44,066 DEBUG [M:0;jenkins-hbase4:35573] zookeeper.ZKUtil(398): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-17 12:13:44,066 WARN [M:0;jenkins-hbase4:35573] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-17 12:13:44,066 INFO [M:0;jenkins-hbase4:35573] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-17 12:13:44,066 INFO [M:0;jenkins-hbase4:35573] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-17 12:13:44,067 DEBUG [M:0;jenkins-hbase4:35573] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-17 12:13:44,067 INFO [M:0;jenkins-hbase4:35573] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 12:13:44,067 DEBUG [M:0;jenkins-hbase4:35573] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 12:13:44,067 DEBUG [M:0;jenkins-hbase4:35573] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-17 12:13:44,067 DEBUG [M:0;jenkins-hbase4:35573] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 12:13:44,067 INFO [M:0;jenkins-hbase4:35573] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.37 KB heapSize=449.60 KB 2023-07-17 12:13:44,092 INFO [M:0;jenkins-hbase4:35573] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.37 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/ccf38a56312b4fc2b83184e32aa6f911 2023-07-17 12:13:44,104 INFO [M:0;jenkins-hbase4:35573] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ccf38a56312b4fc2b83184e32aa6f911 2023-07-17 12:13:44,112 DEBUG [M:0;jenkins-hbase4:35573] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/ccf38a56312b4fc2b83184e32aa6f911 as hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/ccf38a56312b4fc2b83184e32aa6f911 2023-07-17 12:13:44,124 INFO [M:0;jenkins-hbase4:35573] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ccf38a56312b4fc2b83184e32aa6f911 2023-07-17 12:13:44,124 INFO [M:0;jenkins-hbase4:35573] regionserver.HStore(1080): Added hdfs://localhost:40781/user/jenkins/test-data/dd9874ab-9c65-5cf5-1a0e-578ffddd7d8c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/ccf38a56312b4fc2b83184e32aa6f911, entries=119, sequenceid=899, filesize=28.5 K 2023-07-17 12:13:44,125 INFO [M:0;jenkins-hbase4:35573] regionserver.HRegion(2948): Finished flush of dataSize ~373.37 KB/382332, heapSize ~449.59 KB/460376, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 58ms, sequenceid=899, compaction requested=false 2023-07-17 12:13:44,130 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 12:13:44,130 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:44163-0x10173314c320003, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 12:13:44,130 INFO [RS:2;jenkins-hbase4:44163] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,44163,1689595859880; zookeeper connection closed. 2023-07-17 12:13:44,139 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6f123559] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6f123559 2023-07-17 12:13:44,140 INFO [M:0;jenkins-hbase4:35573] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 12:13:44,140 DEBUG [M:0;jenkins-hbase4:35573] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-17 12:13:44,147 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-17 12:13:44,147 INFO [M:0;jenkins-hbase4:35573] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-17 12:13:44,148 INFO [M:0;jenkins-hbase4:35573] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35573 2023-07-17 12:13:44,149 DEBUG [M:0;jenkins-hbase4:35573] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,35573,1689595858202 already deleted, retry=false 2023-07-17 12:13:44,230 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 12:13:44,230 INFO [RS:0;jenkins-hbase4:34107] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,34107,1689595859757; zookeeper connection closed. 2023-07-17 12:13:44,230 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): regionserver:34107-0x10173314c320001, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 12:13:44,230 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4cec36cc] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4cec36cc 2023-07-17 12:13:44,230 INFO [Listener at jenkins-hbase4.apache.org/42275] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-17 12:13:44,330 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 12:13:44,330 INFO [M:0;jenkins-hbase4:35573] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,35573,1689595858202; zookeeper connection closed. 2023-07-17 12:13:44,330 DEBUG [Listener at localhost/40159-EventThread] zookeeper.ZKWatcher(600): master:35573-0x10173314c320000, quorum=127.0.0.1:60075, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 12:13:44,332 WARN [Listener at jenkins-hbase4.apache.org/42275] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-17 12:13:44,336 INFO [Listener at jenkins-hbase4.apache.org/42275] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-17 12:13:44,441 WARN [BP-1177012548-172.31.14.131-1689595854142 heartbeating to localhost/127.0.0.1:40781] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-17 12:13:44,441 WARN [BP-1177012548-172.31.14.131-1689595854142 heartbeating to localhost/127.0.0.1:40781] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1177012548-172.31.14.131-1689595854142 (Datanode Uuid 9b00fe6d-d317-45d5-b8dd-4edc0cc86bdc) service to localhost/127.0.0.1:40781 2023-07-17 12:13:44,443 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/cluster_9a1a9b04-7c81-e777-0050-74120a585f3f/dfs/data/data5/current/BP-1177012548-172.31.14.131-1689595854142] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-17 12:13:44,443 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/cluster_9a1a9b04-7c81-e777-0050-74120a585f3f/dfs/data/data6/current/BP-1177012548-172.31.14.131-1689595854142] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-17 12:13:44,445 WARN [Listener at jenkins-hbase4.apache.org/42275] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-17 12:13:44,449 INFO [Listener at jenkins-hbase4.apache.org/42275] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-17 12:13:44,567 WARN [BP-1177012548-172.31.14.131-1689595854142 heartbeating to localhost/127.0.0.1:40781] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-17 12:13:44,567 WARN [BP-1177012548-172.31.14.131-1689595854142 heartbeating to localhost/127.0.0.1:40781] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1177012548-172.31.14.131-1689595854142 (Datanode Uuid 9c9fd580-9604-430b-a2e2-9accc2a082d3) service to localhost/127.0.0.1:40781 2023-07-17 12:13:44,568 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/cluster_9a1a9b04-7c81-e777-0050-74120a585f3f/dfs/data/data3/current/BP-1177012548-172.31.14.131-1689595854142] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-17 12:13:44,568 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/cluster_9a1a9b04-7c81-e777-0050-74120a585f3f/dfs/data/data4/current/BP-1177012548-172.31.14.131-1689595854142] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-17 12:13:44,570 WARN [Listener at jenkins-hbase4.apache.org/42275] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-17 12:13:44,572 INFO [Listener at jenkins-hbase4.apache.org/42275] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-17 12:13:44,675 WARN [BP-1177012548-172.31.14.131-1689595854142 heartbeating to localhost/127.0.0.1:40781] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-17 12:13:44,675 WARN [BP-1177012548-172.31.14.131-1689595854142 heartbeating to localhost/127.0.0.1:40781] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1177012548-172.31.14.131-1689595854142 (Datanode Uuid de150a68-7580-4b99-99f4-ba7d577ee59c) service to localhost/127.0.0.1:40781 2023-07-17 12:13:44,676 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/cluster_9a1a9b04-7c81-e777-0050-74120a585f3f/dfs/data/data1/current/BP-1177012548-172.31.14.131-1689595854142] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-17 12:13:44,677 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10eb63be-1dd3-0413-3613-d414c7405e00/cluster_9a1a9b04-7c81-e777-0050-74120a585f3f/dfs/data/data2/current/BP-1177012548-172.31.14.131-1689595854142] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-17 12:13:44,708 INFO [Listener at jenkins-hbase4.apache.org/42275] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-17 12:13:44,838 INFO [Listener at jenkins-hbase4.apache.org/42275] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-17 12:13:44,919 INFO [Listener at jenkins-hbase4.apache.org/42275] hbase.HBaseTestingUtility(1293): Minicluster is down